[ 588.011127] env[69637]: INFO neutron.common.config [-] Logging enabled! [ 588.011412] env[69637]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev54 [ 588.011608] env[69637]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69637) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 588.011938] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 588.012118] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 588.012962] env[69637]: WARNING oslo_policy.policy [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 588.013201] env[69637]: WARNING oslo_policy.policy [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 588.014715] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] VMware NSXv3 Agent initialized successfully. [ 588.015079] env[69637]: DEBUG oslo_concurrency.lockutils [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] Acquiring lock "singleton_lock" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.015220] env[69637]: DEBUG oslo_concurrency.lockutils [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] Acquired lock "singleton_lock" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.015426] env[69637]: DEBUG oslo_concurrency.lockutils [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] Releasing lock "singleton_lock" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.015709] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] Full set of CONF: {{(pid=69637) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 588.015921] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ******************************************************************************** {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 588.016052] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] Configuration options gathered from: {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 588.016293] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 588.016471] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 588.016585] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ================================================================================ {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 588.016761] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] agent_down_time = 75 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.016909] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] allow_automatic_dhcp_failover = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.017064] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] allow_bulk = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.017748] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] api_extensions_path = {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.017748] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] api_paste_config = api-paste.ini {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.017748] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] auth_strategy = keystone {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.017748] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] backdoor_port = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.017748] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] backdoor_socket = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.017920] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] backlog = 4096 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.018040] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.018502] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] bind_host = 0.0.0.0 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.018502] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] bind_port = 9696 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.018594] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] client_socket_timeout = 900 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.018720] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] config_dir = [] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.018799] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.018928] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] config_source = [] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.019121] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] control_exchange = neutron {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.019300] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] core_plugin = ml2 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.019450] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] debug = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.019597] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] default_availability_zones = [] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.019815] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.019962] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] dhcp_agent_notification = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.020125] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] dhcp_agents_per_network = 1 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.020257] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] dhcp_lease_duration = 86400 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.020412] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] dhcp_load_type = networks {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.020555] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] dns_domain = openstacklocal {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.020697] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.020838] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] enable_default_route_bfd = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.020978] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] enable_default_route_ecmp = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.021151] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] enable_dvr = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.021301] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] enable_new_agents = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.021439] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.021576] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] enable_signals = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.021712] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] enable_traditional_dhcp = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.021845] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] external_dns_driver = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.021980] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] filter_validation = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.022141] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] global_physnet_mtu = 8950 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.022282] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] graceful_shutdown_timeout = 60 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.022464] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] host = cpu-1 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.022610] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] host_dvr_for_dhcp = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.022750] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] http_retries = 3 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.022895] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] instance_format = [instance: %(uuid)s] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.023063] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.023214] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ipam_driver = internal {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.023354] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ipv6_pd_enabled = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.023491] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] l3_ha = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.023634] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.023775] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] l3_ha_network_physical_name = {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.023916] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] l3_ha_network_type = {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.025036] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] log_color = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.025036] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] log_config_append = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.025036] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.025036] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] log_dir = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.025036] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] log_file = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.025036] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] log_options = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.025036] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] log_rotate_interval = 1 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.025305] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] log_rotate_interval_type = days {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.025305] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] log_rotation_type = none {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.025366] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.025489] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.025613] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.025756] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.025865] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.026017] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] max_dns_nameservers = 5 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.026165] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] max_header_line = 16384 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.026306] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] max_l3_agents_per_router = 3 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.026442] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] max_logfile_count = 30 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.026577] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] max_logfile_size_mb = 200 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.026711] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] max_subnet_host_routes = 20 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.026854] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] my_ip = 10.180.1.21 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.026995] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] my_ipv6 = ::1 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.027145] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] network_auto_schedule = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.027286] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] network_link_prefix = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.027426] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.027566] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] notify_nova_on_port_data_changes = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.027704] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] notify_nova_on_port_status_changes = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.027845] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] pagination_max_limit = -1 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.027980] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] publish_errors = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.028127] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] rate_limit_burst = 0 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.028271] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] rate_limit_except_level = CRITICAL {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.028409] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] rate_limit_interval = 0 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.028545] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] retry_until_window = 30 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.028680] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] router_distributed = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.028815] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] rpc_resources_processing_step = 20 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.028947] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] rpc_response_max_timeout = 600 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.029121] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] rpc_response_timeout = 60 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.029262] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] send_events_interval = 2 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.029415] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] service_plugins = ['router'] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.029560] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] setproctitle = on {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.029694] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] shell_completion = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.029835] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] state_path = /opt/stack/data/neutron {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.029978] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] syslog_log_facility = LOG_USER {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.030130] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] tcp_keepidle = 600 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.030274] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] transport_url = **** {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.030412] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] use_journal = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.030547] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] use_json = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.030683] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] use_ssl = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.030817] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] use_stderr = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.030957] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] use_syslog = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.031134] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] vlan_qinq = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.031284] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] vlan_transparent = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.031420] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] watch_log_file = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.031555] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] wsgi_default_pool_size = 100 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.031689] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] wsgi_keep_alive = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.031835] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.031971] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] wsgi_server_debug = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 588.032185] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_concurrency.disable_process_locking = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.032344] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.032499] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.032643] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.032791] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.032935] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.033089] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.033253] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] profiler.connection_string = messaging:// {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.033411] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] profiler.enabled = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.033571] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] profiler.es_doc_type = notification {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.033727] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] profiler.es_scroll_size = 10000 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.033887] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] profiler.es_scroll_time = 2m {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.034052] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] profiler.filter_error_trace = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.034217] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] profiler.hmac_keys = **** {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.034371] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] profiler.sentinel_service_name = mymaster {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.034521] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] profiler.socket_timeout = 0.1 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.034664] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] profiler.trace_requests = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.034804] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] profiler.trace_sqlalchemy = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.034958] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] profiler_jaeger.process_tags = {} {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.035141] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] profiler_jaeger.service_name_prefix = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.035293] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] profiler_otlp.service_name_prefix = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.035454] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_policy.enforce_new_defaults = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.035728] env[69637]: WARNING oslo_config.cfg [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 588.035888] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_policy.enforce_scope = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.036051] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_policy.policy_default_rule = default {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.036214] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.036365] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.036515] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.036656] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.036795] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.036931] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.037081] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.037235] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.037389] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.037541] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] agent.extensions = [] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.037685] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.037834] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] service_providers.service_provider = [] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.037982] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] QUOTAS.default_quota = -1 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.038144] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.038290] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] QUOTAS.quota_floatingip = 50 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.038434] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] QUOTAS.quota_network = 100 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.038576] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] QUOTAS.quota_port = 500 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.038715] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.038854] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] QUOTAS.quota_router = 10 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.039016] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] QUOTAS.quota_security_group = 10 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.039176] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.039322] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] QUOTAS.quota_subnet = 100 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.039465] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] QUOTAS.track_quota_usage = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.039618] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.039757] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep.group = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.039895] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep.helper_command = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.040057] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.040202] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep.thread_pool_size = 8 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.040343] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep.user = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.040490] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.040631] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_dhcp_release.group = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.040768] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_dhcp_release.helper_command = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.040914] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.041081] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.041231] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_dhcp_release.user = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.041384] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.041524] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_ovs_vsctl.group = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.041662] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.041806] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.041949] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.042116] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_ovs_vsctl.user = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.042279] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_namespace.capabilities = [21] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.042418] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_namespace.group = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.042552] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_namespace.helper_command = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.042696] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.042839] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.042987] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_namespace.user = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.043135] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_conntrack.capabilities = [12] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.043276] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_conntrack.group = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.043414] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_conntrack.helper_command = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.043556] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.043697] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.043834] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_conntrack.user = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.043980] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_link.capabilities = [12, 21] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.044139] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_link.group = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.044303] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_link.helper_command = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.044452] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.044612] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_link.thread_pool_size = 8 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.044726] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] privsep_link.user = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.044883] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.045045] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.045194] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.continue_on_failed_promotions = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.045334] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.dscp = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.045476] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.dscp_inherit = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.045621] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.force_mp_to_policy = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.045760] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.locking_coordinator_url = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.045901] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.log_agent_heartbeats = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.046051] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.logging_expire = 1 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.046202] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.046346] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.046497] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.polling_interval = 240 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.046641] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.046791] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.046937] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.report_interval = 30.0 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.047118] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.047278] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.047427] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.047571] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.sync_skew = 60 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.047715] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.synchronization_queue_size = 20 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.047859] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT.use_helper_for_ns_read = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.048014] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] SECURITYGROUP.enable_ipset = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.048174] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] SECURITYGROUP.enable_security_group = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.048322] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.048467] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.048614] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] experimental.ipv6_pd_enabled = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.048776] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ml2.extension_drivers = ['port_security'] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.048915] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ml2.external_network_type = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.049107] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.049271] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ml2.overlay_ip_version = 4 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.049419] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ml2.path_mtu = 8950 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.049569] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ml2.physical_network_mtus = {} {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.049719] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.049866] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.050018] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ml2.type_drivers = ['vlan'] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.050171] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.050315] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.050457] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.050610] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.050761] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.050908] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.051071] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.051249] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.051404] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.051610] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.051763] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_login_password = **** {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.051918] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.052092] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_login_user = admin {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.052260] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.052416] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.052563] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.052709] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.052857] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.053017] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.053171] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.053320] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.053464] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.053612] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.053766] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.053912] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.054070] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.054275] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.054431] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.054582] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.054735] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.054878] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] nova.auth_section = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.055038] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] nova.auth_type = password {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.055196] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.055336] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] nova.certfile = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.055478] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] nova.collect_timing = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.055630] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] nova.endpoint_type = public {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.055774] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] nova.insecure = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.055912] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] nova.keyfile = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.056072] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] nova.region_name = RegionOne {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.056248] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] nova.split_loggers = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.056409] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] nova.timeout = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.056557] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] placement.auth_section = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.056711] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] placement.auth_type = password {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.056860] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.057009] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] placement.certfile = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.057161] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] placement.collect_timing = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.057314] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] placement.endpoint_type = public {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.057461] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] placement.insecure = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.057602] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] placement.keyfile = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.057742] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] placement.region_name = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.057882] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] placement.split_loggers = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.058029] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] placement.timeout = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.058180] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.auth_section = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.058324] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.auth_type = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.058465] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.cafile = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.058602] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.certfile = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.058745] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.collect_timing = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.058885] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.connect_retries = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.059070] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.connect_retry_delay = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.059240] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.enable_notifications = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.059388] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.endpoint_override = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.059533] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.insecure = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.059675] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.interface = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.059814] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.keyfile = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.059953] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.max_version = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.060104] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.min_version = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.060246] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.region_name = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.060388] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.retriable_status_codes = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.060529] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.service_name = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.060665] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.service_type = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.060810] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.split_loggers = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.060947] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.status_code_retries = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.061129] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.status_code_retry_delay = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.061294] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.timeout = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.061412] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.valid_interfaces = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.061551] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ironic.version = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.061701] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] cli_script.dry_run = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.061858] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.062008] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.062233] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.062326] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.062467] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.062606] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.062745] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.062886] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.063039] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.063198] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.063340] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.063490] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.063636] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.063781] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.063922] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.064082] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.064231] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.064375] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.064527] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.064673] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.064858] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.064958] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.065114] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.065260] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.065400] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.065540] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.065680] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.065821] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.065960] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.066107] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.066252] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.ssl = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.066405] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.066551] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.066691] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.066837] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.066982] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.067136] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.067289] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_notifications.driver = [] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.067430] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_notifications.retry = -1 {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.067585] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.067724] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 588.067835] env[69637]: DEBUG oslo_service.backend.eventlet.service [None req-7977fade-789e-462c-80fd-2311f1667e19 None None] ******************************************************************************** {{(pid=69637) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 588.068874] env[69637]: DEBUG neutron.agent.securitygroups_rpc [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Init firewall settings (driver=nsxv3) {{(pid=69637) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 588.070213] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69637) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 588.070460] env[69637]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] RPC agent_id: nsxm-l-01a.corp.local [ 588.072762] env[69637]: DEBUG dogpile.cache.region [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 588.072888] env[69637]: DEBUG dogpile.lock [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 588.072991] env[69637]: DEBUG dogpile.lock [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 588.073098] env[69637]: DEBUG dogpile.lock [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 588.073197] env[69637]: DEBUG dogpile.cache.region [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 588.073289] env[69637]: DEBUG dogpile.lock [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 588.073416] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 588.124502] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Session token - acquiring [ 588.126044] env[69637]: DEBUG networking_nsxv3.common.locking [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.126259] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.126326] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.127024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.136747] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.412176] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 588.433065] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 588.433198] env[69637]: DEBUG dogpile.cache.region [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Cache value generated in 0.360 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 588.433356] env[69637]: DEBUG dogpile.lock [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 588.433472] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Activating Policy API Provider. [ 588.433689] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Looking for the default Infrastructure Rules. [ 588.517059] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Looking for the Default Layer3 Logged Drop Section. [ 588.531995] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 588.532495] env[69637]: DEBUG networking_nsxv3.common.locking [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.532688] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquiring lock "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.532798] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired lock "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.533069] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired external semaphore "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.533416] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.050749] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.553655] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.058472] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Inventory metadata is going to be refreshed. [ 590.058726] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 590.827519] env[69637]: DEBUG networking_nsxv3.common.locking [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.827519] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.827799] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.827974] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.944049] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 590.944960] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.945859] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 590.964433] env[69637]: DEBUG networking_nsxv3.common.locking [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.964639] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.964691] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.965026] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.965153] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.965302] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 590.965420] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 590.965527] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 590.985751] env[69637]: DEBUG networking_nsxv3.common.locking [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.985942] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.986039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.986300] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.986498] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.986638] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 591.004668] env[69637]: DEBUG networking_nsxv3.common.locking [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.004879] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.004942] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.005173] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.005311] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.005446] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 591.024184] env[69637]: DEBUG networking_nsxv3.common.locking [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.024352] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquiring lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.024442] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.024674] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired external semaphore "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.024807] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Releasing lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.024946] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 591.025065] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 591.025172] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 591.042075] env[69637]: DEBUG networking_nsxv3.common.locking [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.042249] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquiring lock "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.042325] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired lock "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.042552] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired external semaphore "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.042670] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Releasing lock "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.042801] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 591.042907] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 591.043021] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 591.059637] env[69637]: DEBUG networking_nsxv3.common.locking [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.059961] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.059961] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.060171] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.060265] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.060397] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 591.060502] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 591.060604] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Inventory metadata have been refreshed. [ 591.060702] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Dryrun:True. Metadata refresh completed. [ 591.060822] env[69637]: DEBUG oslo_concurrency.lockutils [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Releasing lock "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.062616] env[69637]: INFO neutron.agent.agent_extensions_manager [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Loaded agent extensions: [] [ 591.063347] env[69637]: DEBUG neutron_lib.callbacks.manager [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69637) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 591.109841] env[69637]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] NSXv3 Agent Agent RPC Daemon Started! [ 591.109984] env[69637]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] NSXv3 Agent Agent loop - iteration:0 started [ 591.110074] env[69637]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] NSXv3 Agent Agent out of sync with plugin! [ 595.065785] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.066235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.066235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.066319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.066508] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.568695] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.063959] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 596.064131] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 596.070653] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.572734] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 596.572946] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 597.309707] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.309707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.309707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.309707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.322672] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 597.324228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.324944] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 597.341222] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.341580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.341772] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.342081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.342294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.342509] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 597.342706] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 597.342913] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 597.361044] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.362753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.362753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.362753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.362753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.362753] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 597.383346] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.383346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.383346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.383346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.383346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.383346] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 597.404162] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.404162] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.404162] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.404162] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.404162] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.404162] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 597.404162] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 597.404162] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 597.418739] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.420414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.420414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.420414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.420414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.420414] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 597.420414] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 597.420414] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 597.442045] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.442045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.442045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.442045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.442045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.442045] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 597.442045] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 597.442045] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 597.442045] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 597.442045] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 597.442045] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 597.442045] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 597.442045] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 597.442045] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 597.442045] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 597.459560] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.459560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.459560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.459560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.459560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.459560] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 597.477665] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.477665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.477665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.477665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.477665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.487888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.065520] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 601.065520] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 605.053417] env[69637]: INFO networking_nsxv3.common.synchronization [None req-94000fd0-a874-4f53-966b-38147bf15d21 demo admin] Enqueued Resource ID: 3b35be9d-d94a-4d2d-93aa-a0bc78c0bc65 with Priority: HIGHEST for action security_group_rules [ 605.053417] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b35be9d-d94a-4d2d-93aa-a0bc78c0bc65 with Priority: HIGHEST for action security_group_rules [ 605.053417] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b35be9d-d94a-4d2d-93aa-a0bc78c0bc65 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.053417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b35be9d-d94a-4d2d-93aa-a0bc78c0bc65" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.053417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b35be9d-d94a-4d2d-93aa-a0bc78c0bc65" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.054105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b35be9d-d94a-4d2d-93aa-a0bc78c0bc65" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.054336] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b35be9d-d94a-4d2d-93aa-a0bc78c0bc65',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.575271] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.575271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.575271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.575271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.575271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.575271] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b35be9d-d94a-4d2d-93aa-a0bc78c0bc65 already deleted. [ 605.575271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b35be9d-d94a-4d2d-93aa-a0bc78c0bc65" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.053234] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 610.053580] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 615.054547] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 615.054547] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 620.056570] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 620.056570] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 625.058081] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 625.058526] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 629.928100] env[69637]: INFO networking_nsxv3.common.synchronization [None req-75508b6b-5e21-4ab7-801b-e135ca0ff020 None None] Enqueued Resource ID: 95914761-5e96-4e7f-b291-c4fe915c9102 with Priority: HIGHEST for action port [ 629.928100] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95914761-5e96-4e7f-b291-c4fe915c9102 with Priority: HIGHEST for action port [ 629.928100] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-95914761-5e96-4e7f-b291-c4fe915c9102 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.928100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95914761-5e96-4e7f-b291-c4fe915c9102" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.928100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95914761-5e96-4e7f-b291-c4fe915c9102" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.928100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95914761-5e96-4e7f-b291-c4fe915c9102" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.928100] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95914761-5e96-4e7f-b291-c4fe915c9102',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.430095] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95914761-5e96-4e7f-b291-c4fe915c9102 [ 630.431521] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.431521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.431521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.431521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.431521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.431521] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95914761-5e96-4e7f-b291-c4fe915c9102 already deleted. [ 630.431521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95914761-5e96-4e7f-b291-c4fe915c9102" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.748520] env[69637]: INFO networking_nsxv3.common.synchronization [None req-ce7f5400-22e9-4a76-a727-120c7d99b50f None None] Enqueued Resource ID: afb28f88-6d51-4768-8b11-926897e45991 with Priority: HIGHEST for action port [ 631.748742] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afb28f88-6d51-4768-8b11-926897e45991 with Priority: HIGHEST for action port [ 631.750615] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-afb28f88-6d51-4768-8b11-926897e45991 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.750755] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afb28f88-6d51-4768-8b11-926897e45991" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.750812] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afb28f88-6d51-4768-8b11-926897e45991" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.751711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afb28f88-6d51-4768-8b11-926897e45991" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.751830] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afb28f88-6d51-4768-8b11-926897e45991',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.256094] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afb28f88-6d51-4768-8b11-926897e45991 [ 632.256331] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.256462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.256527] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.256749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.256838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.256930] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afb28f88-6d51-4768-8b11-926897e45991 already deleted. [ 632.257021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afb28f88-6d51-4768-8b11-926897e45991" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.457251] env[69637]: INFO networking_nsxv3.common.synchronization [None req-f9ff94ee-d7ed-4813-bfa7-0c3bd9b37dfb None None] Enqueued Resource ID: 1b4e3911-1dfd-400d-b8da-a0ba9787dd3f with Priority: HIGHEST for action port [ 632.457797] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b4e3911-1dfd-400d-b8da-a0ba9787dd3f with Priority: HIGHEST for action port [ 632.458109] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b4e3911-1dfd-400d-b8da-a0ba9787dd3f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.458260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b4e3911-1dfd-400d-b8da-a0ba9787dd3f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.458321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b4e3911-1dfd-400d-b8da-a0ba9787dd3f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.458578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b4e3911-1dfd-400d-b8da-a0ba9787dd3f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.458664] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b4e3911-1dfd-400d-b8da-a0ba9787dd3f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.963266] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b4e3911-1dfd-400d-b8da-a0ba9787dd3f [ 632.963266] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.963266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.963730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.964152] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.964258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.964364] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b4e3911-1dfd-400d-b8da-a0ba9787dd3f already deleted. [ 632.964449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b4e3911-1dfd-400d-b8da-a0ba9787dd3f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.330034] env[69637]: INFO networking_nsxv3.common.synchronization [None req-db32fb43-1fb2-480e-bd61-22c195e72a95 None None] Enqueued Resource ID: 6aa6591e-7be3-43a6-b7e3-f0c3784be6ed with Priority: HIGHEST for action port [ 634.330034] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aa6591e-7be3-43a6-b7e3-f0c3784be6ed with Priority: HIGHEST for action port [ 634.334017] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-6aa6591e-7be3-43a6-b7e3-f0c3784be6ed taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.334017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6aa6591e-7be3-43a6-b7e3-f0c3784be6ed" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.334017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6aa6591e-7be3-43a6-b7e3-f0c3784be6ed" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.334017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6aa6591e-7be3-43a6-b7e3-f0c3784be6ed" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.334017] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6aa6591e-7be3-43a6-b7e3-f0c3784be6ed',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.572897] env[69637]: INFO networking_nsxv3.common.synchronization [None req-6e20c58d-b49e-4608-b6cb-a2818c5ec3e2 None None] Enqueued Resource ID: b737e3ee-365e-46e2-940d-9178f1bfe377 with Priority: HIGHEST for action port [ 634.573887] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b737e3ee-365e-46e2-940d-9178f1bfe377 with Priority: HIGHEST for action port [ 634.573887] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-b737e3ee-365e-46e2-940d-9178f1bfe377 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.573887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b737e3ee-365e-46e2-940d-9178f1bfe377" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.573887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b737e3ee-365e-46e2-940d-9178f1bfe377" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.574499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b737e3ee-365e-46e2-940d-9178f1bfe377" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.574499] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b737e3ee-365e-46e2-940d-9178f1bfe377',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.839011] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6aa6591e-7be3-43a6-b7e3-f0c3784be6ed [ 634.839011] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.839011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.839479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.839479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.839479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.839479] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6aa6591e-7be3-43a6-b7e3-f0c3784be6ed already deleted. [ 634.839744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6aa6591e-7be3-43a6-b7e3-f0c3784be6ed" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.077394] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b737e3ee-365e-46e2-940d-9178f1bfe377 [ 635.077639] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.077770] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.077843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.078277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.078433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.078502] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b737e3ee-365e-46e2-940d-9178f1bfe377 already deleted. [ 635.078591] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b737e3ee-365e-46e2-940d-9178f1bfe377" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.823154] env[69637]: INFO networking_nsxv3.common.synchronization [None req-1cedda03-f3a7-4b89-8ee1-d9bf87b0bf61 tempest-ServersTestJSON-289349315 tempest-ServersTestJSON-289349315-project-member] Enqueued Resource ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb with Priority: HIGHEST for action security_group_rules [ 635.823154] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb with Priority: HIGHEST for action security_group_rules [ 635.823154] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d9cb429-99aa-4837-be4a-8fc93149f9fb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.823154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.823154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.824417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.824489] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d9cb429-99aa-4837-be4a-8fc93149f9fb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.100156] env[69637]: INFO networking_nsxv3.common.synchronization [None req-bbfa1e89-3191-4073-aafe-bc7d202e36a5 tempest-ServersTestJSON-289349315 tempest-ServersTestJSON-289349315-project-member] Enqueued Resource ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb with Priority: HIGHEST for action security_group_rules [ 636.100201] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb with Priority: HIGHEST for action security_group_rules [ 636.100757] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d9cb429-99aa-4837-be4a-8fc93149f9fb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.100874] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.294303] env[69637]: INFO networking_nsxv3.common.synchronization [None req-4a0f086e-ad7a-430c-af49-526640ab606d None None] Enqueued Resource ID: 061fc638-6730-4450-af2e-02d8ae18c109 with Priority: HIGHEST for action port [ 636.294303] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 061fc638-6730-4450-af2e-02d8ae18c109 with Priority: HIGHEST for action port [ 636.294303] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-061fc638-6730-4450-af2e-02d8ae18c109 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.294303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-061fc638-6730-4450-af2e-02d8ae18c109" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.294509] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-061fc638-6730-4450-af2e-02d8ae18c109" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.294636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-061fc638-6730-4450-af2e-02d8ae18c109" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.294742] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('061fc638-6730-4450-af2e-02d8ae18c109',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.347147] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.347305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.347367] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.347577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.347688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.347752] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb already deleted. [ 636.348258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.348258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.348258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.348258] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d9cb429-99aa-4837-be4a-8fc93149f9fb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.799259] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 061fc638-6730-4450-af2e-02d8ae18c109 [ 636.799259] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.799259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.799259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.799259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.799259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.799259] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:061fc638-6730-4450-af2e-02d8ae18c109 already deleted. [ 636.799259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-061fc638-6730-4450-af2e-02d8ae18c109" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.875032] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.875032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.875032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.875032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.875032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.875032] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb already deleted. [ 636.875032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.198727] env[69637]: INFO networking_nsxv3.common.synchronization [None req-cab68e10-5f06-4873-93fb-48a2a23cb896 None None] Enqueued Resource ID: abe2b4df-c940-428a-b32b-1608e9c54eee with Priority: HIGHEST for action port [ 637.198770] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abe2b4df-c940-428a-b32b-1608e9c54eee with Priority: HIGHEST for action port [ 637.199804] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-abe2b4df-c940-428a-b32b-1608e9c54eee taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.199804] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abe2b4df-c940-428a-b32b-1608e9c54eee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.199804] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abe2b4df-c940-428a-b32b-1608e9c54eee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.199804] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abe2b4df-c940-428a-b32b-1608e9c54eee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.199804] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abe2b4df-c940-428a-b32b-1608e9c54eee',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.213470] env[69637]: INFO networking_nsxv3.common.synchronization [None req-9ff82530-0bbc-4168-a064-8eebd9dc1a68 None None] Enqueued Resource ID: 23fdce3a-fb96-4e5b-96de-68ffa657f214 with Priority: HIGHEST for action port [ 637.213651] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fdce3a-fb96-4e5b-96de-68ffa657f214 with Priority: HIGHEST for action port [ 637.214211] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-23fdce3a-fb96-4e5b-96de-68ffa657f214 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.214429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23fdce3a-fb96-4e5b-96de-68ffa657f214" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.214429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23fdce3a-fb96-4e5b-96de-68ffa657f214" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.214668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23fdce3a-fb96-4e5b-96de-68ffa657f214" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.214743] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23fdce3a-fb96-4e5b-96de-68ffa657f214',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.661717] env[69637]: INFO networking_nsxv3.common.synchronization [None req-d95c48e3-33d4-4ccf-83b6-1f71ad795be7 None None] Enqueued Resource ID: fe309678-620b-42c1-a8cc-c942646b7123 with Priority: HIGHEST for action port [ 637.661717] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe309678-620b-42c1-a8cc-c942646b7123 with Priority: HIGHEST for action port [ 637.661944] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe309678-620b-42c1-a8cc-c942646b7123 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.662194] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe309678-620b-42c1-a8cc-c942646b7123" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.662194] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe309678-620b-42c1-a8cc-c942646b7123" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.662504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe309678-620b-42c1-a8cc-c942646b7123" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.662504] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe309678-620b-42c1-a8cc-c942646b7123',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.704662] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abe2b4df-c940-428a-b32b-1608e9c54eee [ 637.704870] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.705014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.705092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.705527] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.705527] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.705527] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abe2b4df-c940-428a-b32b-1608e9c54eee already deleted. [ 637.706128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abe2b4df-c940-428a-b32b-1608e9c54eee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.723714] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23fdce3a-fb96-4e5b-96de-68ffa657f214 [ 637.723932] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.724077] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.724147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.724358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.724449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.724539] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23fdce3a-fb96-4e5b-96de-68ffa657f214 already deleted. [ 637.724621] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23fdce3a-fb96-4e5b-96de-68ffa657f214" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.084489] env[69637]: INFO networking_nsxv3.common.synchronization [None req-f70ce9fb-1998-49ea-b2ee-81ec8c591f3a None None] Enqueued Resource ID: 20841001-5f06-42e4-ae2c-6fb1952a3a1e with Priority: HIGHEST for action port [ 638.084489] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20841001-5f06-42e4-ae2c-6fb1952a3a1e with Priority: HIGHEST for action port [ 638.084489] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-20841001-5f06-42e4-ae2c-6fb1952a3a1e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.084489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20841001-5f06-42e4-ae2c-6fb1952a3a1e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.084489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20841001-5f06-42e4-ae2c-6fb1952a3a1e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.084899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20841001-5f06-42e4-ae2c-6fb1952a3a1e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.084899] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20841001-5f06-42e4-ae2c-6fb1952a3a1e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.167768] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe309678-620b-42c1-a8cc-c942646b7123 [ 638.167768] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.167768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.167768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.167768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.167768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.167768] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe309678-620b-42c1-a8cc-c942646b7123 already deleted. [ 638.167768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe309678-620b-42c1-a8cc-c942646b7123" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.589318] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20841001-5f06-42e4-ae2c-6fb1952a3a1e [ 638.589318] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.589318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.589318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.589318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.589318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.589318] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20841001-5f06-42e4-ae2c-6fb1952a3a1e already deleted. [ 638.589318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20841001-5f06-42e4-ae2c-6fb1952a3a1e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.589318] env[69637]: INFO networking_nsxv3.common.synchronization [None req-4bf76304-f950-43be-91b1-f6604968b641 None None] Enqueued Resource ID: 688bbe99-d115-4531-b312-9aa225b4aaad with Priority: HIGHEST for action port [ 638.590134] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 688bbe99-d115-4531-b312-9aa225b4aaad with Priority: HIGHEST for action port [ 638.590431] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-688bbe99-d115-4531-b312-9aa225b4aaad taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.591485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-688bbe99-d115-4531-b312-9aa225b4aaad" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.591740] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-688bbe99-d115-4531-b312-9aa225b4aaad" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.592126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-688bbe99-d115-4531-b312-9aa225b4aaad" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.592649] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('688bbe99-d115-4531-b312-9aa225b4aaad',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.094906] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 688bbe99-d115-4531-b312-9aa225b4aaad [ 639.095181] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.095278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.095371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.095556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.095642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.095748] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:688bbe99-d115-4531-b312-9aa225b4aaad already deleted. [ 639.095807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-688bbe99-d115-4531-b312-9aa225b4aaad" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.194991] env[69637]: INFO networking_nsxv3.common.synchronization [None req-32e18f61-2c48-4a62-a35b-d94860d9a43f None None] Enqueued Resource ID: 5cfbbbfb-d9f9-4ce5-82d1-e3beaa9bcbd5 with Priority: HIGHEST for action port [ 639.194991] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cfbbbfb-d9f9-4ce5-82d1-e3beaa9bcbd5 with Priority: HIGHEST for action port [ 639.196478] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cfbbbfb-d9f9-4ce5-82d1-e3beaa9bcbd5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.196478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cfbbbfb-d9f9-4ce5-82d1-e3beaa9bcbd5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.196478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cfbbbfb-d9f9-4ce5-82d1-e3beaa9bcbd5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.196478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cfbbbfb-d9f9-4ce5-82d1-e3beaa9bcbd5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.196478] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cfbbbfb-d9f9-4ce5-82d1-e3beaa9bcbd5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.698082] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5cfbbbfb-d9f9-4ce5-82d1-e3beaa9bcbd5 [ 639.698227] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.698363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.698453] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.698678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.698749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.698841] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5cfbbbfb-d9f9-4ce5-82d1-e3beaa9bcbd5 already deleted. [ 639.698921] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cfbbbfb-d9f9-4ce5-82d1-e3beaa9bcbd5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.772820] env[69637]: INFO networking_nsxv3.common.synchronization [None req-48e7882c-f84a-4015-901c-62af7df8c8c5 None None] Enqueued Resource ID: 6883958e-ab23-4f3f-b95b-2413dfb759c8 with Priority: HIGHEST for action port [ 639.772820] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6883958e-ab23-4f3f-b95b-2413dfb759c8 with Priority: HIGHEST for action port [ 639.773020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-6883958e-ab23-4f3f-b95b-2413dfb759c8 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.773127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6883958e-ab23-4f3f-b95b-2413dfb759c8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.773181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6883958e-ab23-4f3f-b95b-2413dfb759c8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.773442] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6883958e-ab23-4f3f-b95b-2413dfb759c8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.773536] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6883958e-ab23-4f3f-b95b-2413dfb759c8',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.275904] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6883958e-ab23-4f3f-b95b-2413dfb759c8 [ 640.278227] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.278227] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.278227] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.278227] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.278227] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.278227] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6883958e-ab23-4f3f-b95b-2413dfb759c8 already deleted. [ 640.278227] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6883958e-ab23-4f3f-b95b-2413dfb759c8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.856577] env[69637]: INFO networking_nsxv3.common.synchronization [None req-e0bad6e5-f7dd-47b5-ae20-6fa6520745e2 None None] Enqueued Resource ID: f65902a9-279d-4cd6-b19b-c241ed8d0c2c with Priority: HIGHEST for action port [ 640.856577] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65902a9-279d-4cd6-b19b-c241ed8d0c2c with Priority: HIGHEST for action port [ 640.856577] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-f65902a9-279d-4cd6-b19b-c241ed8d0c2c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.856577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f65902a9-279d-4cd6-b19b-c241ed8d0c2c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.856577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f65902a9-279d-4cd6-b19b-c241ed8d0c2c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.856768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f65902a9-279d-4cd6-b19b-c241ed8d0c2c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.856768] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f65902a9-279d-4cd6-b19b-c241ed8d0c2c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.359847] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f65902a9-279d-4cd6-b19b-c241ed8d0c2c [ 641.360208] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.360269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.360802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.360802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.360802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.360802] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f65902a9-279d-4cd6-b19b-c241ed8d0c2c already deleted. [ 641.360956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f65902a9-279d-4cd6-b19b-c241ed8d0c2c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.218019] env[69637]: INFO networking_nsxv3.common.synchronization [None req-4acf8494-337e-4a2c-846a-50ff335fded1 None None] Enqueued Resource ID: a407b824-da9f-4967-8d14-3f04f4b5ff5e with Priority: HIGHEST for action port [ 642.218019] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a407b824-da9f-4967-8d14-3f04f4b5ff5e with Priority: HIGHEST for action port [ 642.218211] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-a407b824-da9f-4967-8d14-3f04f4b5ff5e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.218336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a407b824-da9f-4967-8d14-3f04f4b5ff5e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.218413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a407b824-da9f-4967-8d14-3f04f4b5ff5e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.218680] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a407b824-da9f-4967-8d14-3f04f4b5ff5e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.218758] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a407b824-da9f-4967-8d14-3f04f4b5ff5e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.723306] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a407b824-da9f-4967-8d14-3f04f4b5ff5e [ 642.723757] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.724073] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.724170] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.724427] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.724670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.724802] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a407b824-da9f-4967-8d14-3f04f4b5ff5e already deleted. [ 642.724942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a407b824-da9f-4967-8d14-3f04f4b5ff5e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.228076] env[69637]: INFO networking_nsxv3.common.synchronization [req-4fa8f733-0a51-4207-9b16-286e6c86551a req-236d9ee4-cb52-4998-bda1-6412430788ca tempest-ServersAdminNegativeTestJSON-2061472953 tempest-ServersAdminNegativeTestJSON-2061472953-project-member] Enqueued Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_members [ 643.228076] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_members [ 643.228076] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-552e4f46-9b42-4666-9223-428ed3c3368c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.228076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.228076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.228076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.228076] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.228076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.228076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.228076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.228076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.228076] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.730532] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.730818] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.730818] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.730992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.731089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.731278] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.731372] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.731428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.731583] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.731663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.731915] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 552e4f46-9b42-4666-9223-428ed3c3368c already deleted. [ 643.731915] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.527330] env[69637]: INFO networking_nsxv3.common.synchronization [None req-d9a558b8-e15a-4743-9206-e3fa71796c6d None None] Enqueued Resource ID: 766943d9-0f21-42cc-a72f-91ddcf25d465 with Priority: HIGHEST for action port [ 644.527330] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 766943d9-0f21-42cc-a72f-91ddcf25d465 with Priority: HIGHEST for action port [ 644.527887] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-766943d9-0f21-42cc-a72f-91ddcf25d465 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.527887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-766943d9-0f21-42cc-a72f-91ddcf25d465" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.527887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-766943d9-0f21-42cc-a72f-91ddcf25d465" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.527887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-766943d9-0f21-42cc-a72f-91ddcf25d465" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.531231] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('766943d9-0f21-42cc-a72f-91ddcf25d465',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.621041] env[69637]: INFO networking_nsxv3.common.synchronization [None req-0dc4fdf7-e523-4854-bfe5-64c4586128ac tempest-VolumesAdminNegativeTest-82035611 tempest-VolumesAdminNegativeTest-82035611-project-member] Enqueued Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGHEST for action security_group_rules [ 644.621750] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGHEST for action security_group_rules [ 644.622120] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.622255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.622320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.622576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.622725] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ebf57d6-6da5-49a3-83b3-8e08d42464db',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.704401] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.704660] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.704739] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.706777] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.706777] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.706777] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.706777] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.706777] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.706777] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.707240] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 644.707240] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 644.707385] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 644.707429] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 644.707612] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 644.708095] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 644.708095] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 644.731663] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 644.732046] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 644.732200] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 644.732379] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.732844] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-53403687-08be-4b1e-967e-259019c57c8a taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.732957] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-53403687-08be-4b1e-967e-259019c57c8a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.733079] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-53403687-08be-4b1e-967e-259019c57c8a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.733382] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-53403687-08be-4b1e-967e-259019c57c8a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.733537] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53403687-08be-4b1e-967e-259019c57c8a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.034803] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 766943d9-0f21-42cc-a72f-91ddcf25d465 [ 645.034803] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.034803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.034803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.034803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.034803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.034803] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:766943d9-0f21-42cc-a72f-91ddcf25d465 already deleted. [ 645.034803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-766943d9-0f21-42cc-a72f-91ddcf25d465" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.040222] env[69637]: INFO networking_nsxv3.common.synchronization [None req-bd080148-75ce-4d7d-ab96-8a21c51ba82a tempest-VolumesAdminNegativeTest-82035611 tempest-VolumesAdminNegativeTest-82035611-project-member] Enqueued Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGHEST for action security_group_rules [ 645.040222] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGHEST for action security_group_rules [ 645.040222] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.040222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.150155] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.150155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.150155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.150155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.150155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.150155] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db already deleted. [ 645.150155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.150155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.150155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.150155] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ebf57d6-6da5-49a3-83b3-8e08d42464db',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.167522] env[69637]: INFO networking_nsxv3.common.synchronization [None req-7e5f616b-1f55-45ef-8ea2-4dc4f3ed43c9 None None] Enqueued Resource ID: c74de357-b975-481b-8317-eb44df7256e7 with Priority: HIGHEST for action port [ 645.167522] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c74de357-b975-481b-8317-eb44df7256e7 with Priority: HIGHEST for action port [ 645.167522] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-c74de357-b975-481b-8317-eb44df7256e7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.167522] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c74de357-b975-481b-8317-eb44df7256e7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.167522] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c74de357-b975-481b-8317-eb44df7256e7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.167522] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c74de357-b975-481b-8317-eb44df7256e7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.167522] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c74de357-b975-481b-8317-eb44df7256e7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.236821] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.236987] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.237138] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.240518] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.240617] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.240831] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 53403687-08be-4b1e-967e-259019c57c8a not found, creating... [ 645.241124] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.241302] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.241421] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.241730] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.241873] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.242675] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.242675] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.242675] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.242870] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.243050] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.243145] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 53403687-08be-4b1e-967e-259019c57c8a is going to be created. [ 645.264261] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.264402] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.264402] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.264704] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.264935] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.265193] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-53403687-08be-4b1e-967e-259019c57c8a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.531642] env[69637]: INFO networking_nsxv3.common.synchronization [None req-45033919-5ff0-45cd-a6cd-e9574c70d4a8 None None] Enqueued Resource ID: 31b68f64-8544-4058-95e8-e7978ac44b83 with Priority: HIGHEST for action port [ 645.531737] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31b68f64-8544-4058-95e8-e7978ac44b83 with Priority: HIGHEST for action port [ 645.534955] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-31b68f64-8544-4058-95e8-e7978ac44b83 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.534955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31b68f64-8544-4058-95e8-e7978ac44b83" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.534955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31b68f64-8544-4058-95e8-e7978ac44b83" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.535244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31b68f64-8544-4058-95e8-e7978ac44b83" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.535244] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31b68f64-8544-4058-95e8-e7978ac44b83',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.669894] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.670059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.670059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.670269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.670353] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.670445] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db already deleted. [ 645.670625] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.670751] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c74de357-b975-481b-8317-eb44df7256e7 [ 645.670882] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.670975] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.671049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.671192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.671271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.671347] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c74de357-b975-481b-8317-eb44df7256e7 already deleted. [ 645.671424] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c74de357-b975-481b-8317-eb44df7256e7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.038925] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31b68f64-8544-4058-95e8-e7978ac44b83 [ 646.039212] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.039363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.039404] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.039584] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.039675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.039768] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31b68f64-8544-4058-95e8-e7978ac44b83 already deleted. [ 646.039850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31b68f64-8544-4058-95e8-e7978ac44b83" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.400068] env[69637]: INFO networking_nsxv3.common.synchronization [req-4fa8f733-0a51-4207-9b16-286e6c86551a req-ed200be8-b80c-49d3-8d67-9e225177ee67 service nova] Enqueued Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_rules [ 646.403020] env[69637]: INFO networking_nsxv3.common.synchronization [req-4fa8f733-0a51-4207-9b16-286e6c86551a req-ed200be8-b80c-49d3-8d67-9e225177ee67 service nova] Enqueued Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_members [ 646.403020] env[69637]: INFO networking_nsxv3.common.synchronization [req-4fa8f733-0a51-4207-9b16-286e6c86551a req-ed200be8-b80c-49d3-8d67-9e225177ee67 service nova] Enqueued Resource ID: 53403687-08be-4b1e-967e-259019c57c8a with Priority: HIGHEST for action port [ 646.403623] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_rules [ 646.404218] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_members [ 646.404366] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53403687-08be-4b1e-967e-259019c57c8a with Priority: HIGHEST for action port [ 646.406526] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-552e4f46-9b42-4666-9223-428ed3c3368c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.407617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.407711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.407979] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.408080] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.409337] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-552e4f46-9b42-4666-9223-428ed3c3368c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.409457] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.409529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.409708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.409949] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.409949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.410080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.410166] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.410248] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.410338] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.412440] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-53403687-08be-4b1e-967e-259019c57c8a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.412577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53403687-08be-4b1e-967e-259019c57c8a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.413025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53403687-08be-4b1e-967e-259019c57c8a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.413025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53403687-08be-4b1e-967e-259019c57c8a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.413146] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53403687-08be-4b1e-967e-259019c57c8a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.916085] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-552e4f46-9b42-4666-9223-428ed3c3368c taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.918376] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.944777] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53403687-08be-4b1e-967e-259019c57c8a with status ACTIVE [ 646.944777] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.944777] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.946472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.946472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.946472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.946472] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.946472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.946472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.946472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.946472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.946472] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.946472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.946472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.946906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.946906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.946906] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53403687-08be-4b1e-967e-259019c57c8a is going to be updated. [ 646.948040] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.969714] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.970662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.970662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.970662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.970662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.970662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53403687-08be-4b1e-967e-259019c57c8a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.080199] env[69637]: INFO networking_nsxv3.common.synchronization [None req-6d606136-67d0-4cf9-ac86-15936b01038d None None] Enqueued Resource ID: 8410737a-28ad-4f1b-9acd-3b4c6d3ef7f4 with Priority: HIGHEST for action port [ 647.081698] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8410737a-28ad-4f1b-9acd-3b4c6d3ef7f4 with Priority: HIGHEST for action port [ 647.081698] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-8410737a-28ad-4f1b-9acd-3b4c6d3ef7f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.082161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8410737a-28ad-4f1b-9acd-3b4c6d3ef7f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.082245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8410737a-28ad-4f1b-9acd-3b4c6d3ef7f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.082498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8410737a-28ad-4f1b-9acd-3b4c6d3ef7f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.082584] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8410737a-28ad-4f1b-9acd-3b4c6d3ef7f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.450695] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.587993] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8410737a-28ad-4f1b-9acd-3b4c6d3ef7f4 [ 647.587993] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.588206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.588206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.588624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.588624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.588624] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8410737a-28ad-4f1b-9acd-3b4c6d3ef7f4 already deleted. [ 647.588624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8410737a-28ad-4f1b-9acd-3b4c6d3ef7f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.906480] env[69637]: INFO networking_nsxv3.common.synchronization [req-b5073bd9-e14c-4500-a730-9328e14009d1 req-031abbc2-adc1-4f0b-bcac-a51cd6507271 tempest-ServersTestJSON-289349315 tempest-ServersTestJSON-289349315-project-member] Enqueued Resource ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb with Priority: HIGHEST for action security_group_members [ 647.908578] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb with Priority: HIGHEST for action security_group_members [ 647.908929] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d9cb429-99aa-4837-be4a-8fc93149f9fb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.909116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.909529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.909529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.909880] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.911149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.911149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.911149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.911149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.911149] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d9cb429-99aa-4837-be4a-8fc93149f9fb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.955161] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.955474] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.955647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.956203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.956593] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.956926] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 552e4f46-9b42-4666-9223-428ed3c3368c is going to be created. [ 647.986440] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.986540] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.986540] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.986746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.986986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.995466] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 552e4f46-9b42-4666-9223-428ed3c3368c in Status: UNINITIALIZED for 2s [ 648.413995] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.414832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.415295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.416318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.416681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.417019] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.417540] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.418772] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.418772] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.418772] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.418772] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb already deleted. [ 648.418772] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.740246] env[69637]: INFO networking_nsxv3.common.synchronization [None req-c9bed948-9886-4f6b-aa34-12a44730f4ba None None] Enqueued Resource ID: 86527de0-599b-4cc4-99a1-ce468054f621 with Priority: HIGHEST for action port [ 648.740246] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86527de0-599b-4cc4-99a1-ce468054f621 with Priority: HIGHEST for action port [ 648.740246] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-86527de0-599b-4cc4-99a1-ce468054f621 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.740246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86527de0-599b-4cc4-99a1-ce468054f621" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.740246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86527de0-599b-4cc4-99a1-ce468054f621" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.740246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86527de0-599b-4cc4-99a1-ce468054f621" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.740246] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86527de0-599b-4cc4-99a1-ce468054f621',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.190649] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.190899] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-478" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.191040] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-478" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.191414] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-478" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.191712] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.191867] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.191986] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.193348] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.193526] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.193722] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.193852] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.193948] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.194071] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.194237] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.194286] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.194418] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.213639] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.215537] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 649.215820] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.216144] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-478" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.216700] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-1ae355bc-23f1-4e69-9f0e-83cfc042a9d8 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.217870] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-1ae355bc-23f1-4e69-9f0e-83cfc042a9d8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.217870] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-1ae355bc-23f1-4e69-9f0e-83cfc042a9d8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.217870] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-1ae355bc-23f1-4e69-9f0e-83cfc042a9d8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.217870] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ae355bc-23f1-4e69-9f0e-83cfc042a9d8',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.244225] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86527de0-599b-4cc4-99a1-ce468054f621 [ 649.244897] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.245843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.245843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.245843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.245843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.245843] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86527de0-599b-4cc4-99a1-ce468054f621 already deleted. [ 649.245843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86527de0-599b-4cc4-99a1-ce468054f621" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.535631] env[69637]: INFO networking_nsxv3.common.synchronization [req-e3edac9e-3ee1-437a-a004-8910e972e3cd req-b980476f-3c6c-404a-aa06-77e5198167de tempest-DeleteServersAdminTestJSON-551815227 tempest-DeleteServersAdminTestJSON-551815227-project-member] Enqueued Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_members [ 649.535631] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_members [ 649.535631] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-645e75b0-47c9-44b7-81c7-713e50cf04dc taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.535631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.535631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.537016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.537592] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.538349] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.538752] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.539013] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.539192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.542866] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.721222] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.721222] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.721222] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.721222] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.725020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.725020] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 1ae355bc-23f1-4e69-9f0e-83cfc042a9d8 not found, creating... [ 649.725020] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.725020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.725020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.725020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.725020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.725020] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.725020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.725020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.726325] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.726550] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.726824] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 1ae355bc-23f1-4e69-9f0e-83cfc042a9d8 is going to be created. [ 649.747309] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.747768] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.748961] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.748961] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.748961] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.749466] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-1ae355bc-23f1-4e69-9f0e-83cfc042a9d8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.806269] env[69637]: INFO networking_nsxv3.common.synchronization [None req-a7fa7c1d-f5db-46ed-bcdf-00b7b2c54410 None None] Enqueued Resource ID: 8a93e1ae-edc1-4455-aeee-60281b6cea9b with Priority: HIGHEST for action port [ 649.807251] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a93e1ae-edc1-4455-aeee-60281b6cea9b with Priority: HIGHEST for action port [ 649.810478] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a93e1ae-edc1-4455-aeee-60281b6cea9b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.810627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a93e1ae-edc1-4455-aeee-60281b6cea9b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.810980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a93e1ae-edc1-4455-aeee-60281b6cea9b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.810980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a93e1ae-edc1-4455-aeee-60281b6cea9b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.811138] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a93e1ae-edc1-4455-aeee-60281b6cea9b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.871446] env[69637]: INFO networking_nsxv3.common.synchronization [None req-96ade577-3f43-413b-8731-f1e3be4effa3 None None] Enqueued Resource ID: 1da90005-6d66-41a2-8b88-839475490efa with Priority: HIGHEST for action port [ 649.871446] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1da90005-6d66-41a2-8b88-839475490efa with Priority: HIGHEST for action port [ 649.871446] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-1da90005-6d66-41a2-8b88-839475490efa taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.871446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1da90005-6d66-41a2-8b88-839475490efa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.871446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1da90005-6d66-41a2-8b88-839475490efa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.873031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1da90005-6d66-41a2-8b88-839475490efa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.873031] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1da90005-6d66-41a2-8b88-839475490efa',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.005539] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 552e4f46-9b42-4666-9223-428ed3c3368c in Status: SUCCESS [ 650.006969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.006969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.006969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.006969] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.008582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.008582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.008582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.008582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.008582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.008582] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.046342] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.046342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.046342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.046342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.046342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.046342] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.046342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.046342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.046342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.046342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.046342] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc already deleted. [ 650.046342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.229142] env[69637]: INFO networking_nsxv3.common.synchronization [None req-0935de09-ef65-4974-98b1-94db741bdd1e tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 2bea8a67-35df-45be-bf57-95c80494d7fe with Priority: HIGHEST for action security_group_rules [ 650.229142] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bea8a67-35df-45be-bf57-95c80494d7fe with Priority: HIGHEST for action security_group_rules [ 650.229303] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bea8a67-35df-45be-bf57-95c80494d7fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.229550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.229727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.230078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.232717] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bea8a67-35df-45be-bf57-95c80494d7fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.315090] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a93e1ae-edc1-4455-aeee-60281b6cea9b [ 650.315090] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.315090] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.315090] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.315090] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.315090] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.315090] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a93e1ae-edc1-4455-aeee-60281b6cea9b already deleted. [ 650.315090] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a93e1ae-edc1-4455-aeee-60281b6cea9b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.377351] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1da90005-6d66-41a2-8b88-839475490efa [ 650.378079] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.378079] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.378079] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.378079] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.378079] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.378537] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1da90005-6d66-41a2-8b88-839475490efa already deleted. [ 650.378537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1da90005-6d66-41a2-8b88-839475490efa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.514057] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-552e4f46-9b42-4666-9223-428ed3c3368c taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.514169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.514237] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.514454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.514739] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.514909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.514969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.515467] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.515467] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.515467] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.516243] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-552e4f46-9b42-4666-9223-428ed3c3368c taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.516243] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.516243] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.516243] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.516243] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.516243] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.516243] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.516577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.516577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.516577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.516660] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.757468] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.757468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.757468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.757976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.758022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.758117] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bea8a67-35df-45be-bf57-95c80494d7fe already deleted. [ 650.758202] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.770109] env[69637]: INFO networking_nsxv3.common.synchronization [None req-8d5e001b-80dd-406c-a2ce-5fbe27cd05a8 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 2bea8a67-35df-45be-bf57-95c80494d7fe with Priority: HIGHEST for action security_group_rules [ 650.770788] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bea8a67-35df-45be-bf57-95c80494d7fe with Priority: HIGHEST for action security_group_rules [ 650.771392] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bea8a67-35df-45be-bf57-95c80494d7fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.771392] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.771392] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.771571] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.771605] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bea8a67-35df-45be-bf57-95c80494d7fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.020867] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 552e4f46-9b42-4666-9223-428ed3c3368c: rpc.has_security_group_logging(os_id): False [ 651.044136] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.044136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.044136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.044136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.044136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.044136] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.044136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.044136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.044136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.044136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.044136] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.044136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.044136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.044136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.044136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.044682] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.046235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.046333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.046515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.046863] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.046863] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 552e4f46-9b42-4666-9223-428ed3c3368c is going to be created. [ 651.131283] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.132677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.133154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.133154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.133239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.150263] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 552e4f46-9b42-4666-9223-428ed3c3368c in Status: IN_PROGRESS for 2s [ 651.306103] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.306463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.306551] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.306861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.306861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.307502] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bea8a67-35df-45be-bf57-95c80494d7fe already deleted. [ 651.307502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.417198] env[69637]: INFO networking_nsxv3.common.synchronization [req-b5073bd9-e14c-4500-a730-9328e14009d1 req-a63ae8db-2448-4fd5-97dd-5e5576c9fcd3 service nova] Enqueued Resource ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb with Priority: HIGHEST for action security_group_rules [ 651.417198] env[69637]: INFO networking_nsxv3.common.synchronization [req-b5073bd9-e14c-4500-a730-9328e14009d1 req-a63ae8db-2448-4fd5-97dd-5e5576c9fcd3 service nova] Enqueued Resource ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb with Priority: HIGHEST for action security_group_members [ 651.417356] env[69637]: INFO networking_nsxv3.common.synchronization [req-b5073bd9-e14c-4500-a730-9328e14009d1 req-a63ae8db-2448-4fd5-97dd-5e5576c9fcd3 service nova] Enqueued Resource ID: 1ae355bc-23f1-4e69-9f0e-83cfc042a9d8 with Priority: HIGHEST for action port [ 651.417585] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb with Priority: HIGHEST for action security_group_rules [ 651.417706] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb with Priority: HIGHEST for action security_group_members [ 651.417793] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ae355bc-23f1-4e69-9f0e-83cfc042a9d8 with Priority: HIGHEST for action port [ 651.419404] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d9cb429-99aa-4837-be4a-8fc93149f9fb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.419545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.420064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.420446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.420668] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d9cb429-99aa-4837-be4a-8fc93149f9fb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.422824] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d9cb429-99aa-4837-be4a-8fc93149f9fb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.423027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.423162] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.423622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.423925] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.424311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.424375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.424556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.424662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.425258] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d9cb429-99aa-4837-be4a-8fc93149f9fb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.426028] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ae355bc-23f1-4e69-9f0e-83cfc042a9d8 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.426142] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ae355bc-23f1-4e69-9f0e-83cfc042a9d8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.426260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ae355bc-23f1-4e69-9f0e-83cfc042a9d8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.426373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ae355bc-23f1-4e69-9f0e-83cfc042a9d8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.426450] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ae355bc-23f1-4e69-9f0e-83cfc042a9d8',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.496681] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.496901] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.497035] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.497913] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.497913] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.497913] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.497913] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.498265] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.498504] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.498720] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.499311] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.499634] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.499830] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.500023] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.500126] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.500223] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.518610] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.518610] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 651.519079] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.519839] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.521183] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-77bed287-a877-43a4-afb4-be2b0c2e5aa1 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.521183] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-77bed287-a877-43a4-afb4-be2b0c2e5aa1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.521183] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-77bed287-a877-43a4-afb4-be2b0c2e5aa1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.522703] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-77bed287-a877-43a4-afb4-be2b0c2e5aa1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.522703] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77bed287-a877-43a4-afb4-be2b0c2e5aa1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.851658] env[69637]: INFO networking_nsxv3.common.synchronization [req-88d8631d-b533-4c11-86d2-643901a0f884 req-326a15ac-1231-4996-94af-4c086c440081 tempest-ImagesTestJSON-1924392618 tempest-ImagesTestJSON-1924392618-project-member] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 651.852527] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 651.852760] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.853192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.853192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.854605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.854605] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.854605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.854605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.854605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.854605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.854605] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.931029] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ae355bc-23f1-4e69-9f0e-83cfc042a9d8 with status ACTIVE [ 651.931029] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.931029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.931029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.931029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.931029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.931029] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.931029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.931029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.931029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.931029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.931029] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.931029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.931029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.931029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.931029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.931029] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ae355bc-23f1-4e69-9f0e-83cfc042a9d8 is going to be updated. [ 651.932968] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d9cb429-99aa-4837-be4a-8fc93149f9fb taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.933113] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.933275] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d9cb429-99aa-4837-be4a-8fc93149f9fb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.953613] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.953767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.954098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.954867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.954867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.955057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ae355bc-23f1-4e69-9f0e-83cfc042a9d8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.026483] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.026483] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.026483] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.026483] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.026483] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.026755] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 77bed287-a877-43a4-afb4-be2b0c2e5aa1 not found, creating... [ 652.026794] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.027044] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.027044] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.027275] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.027459] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.027662] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.027803] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.028017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.029879] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.030047] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.030197] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 77bed287-a877-43a4-afb4-be2b0c2e5aa1 is going to be created. [ 652.051662] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.053292] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.053292] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.053292] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.053292] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.053292] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-77bed287-a877-43a4-afb4-be2b0c2e5aa1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.357321] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.357494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.357567] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.357798] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.357891] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.358094] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.358280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.358280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.358405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.358484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.358575] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 already deleted. [ 652.358645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.435680] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d9cb429-99aa-4837-be4a-8fc93149f9fb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.939351] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.939695] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.939695] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.941471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.941471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.941471] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb is going to be created. [ 652.963237] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.963491] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.963601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.963857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.964083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.978523] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb in Status: UNINITIALIZED for 2s [ 653.164539] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 552e4f46-9b42-4666-9223-428ed3c3368c in Status: SUCCESS [ 653.165540] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.433130] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.433130] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.433130] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.433130] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.434213] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.434213] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.434377] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.434538] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.434718] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.435368] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.435368] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.435368] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.435697] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.435864] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.436168] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.436168] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.454404] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.454609] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 653.454758] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.455141] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.455314] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-7513d9b0-3021-45e2-8bc3-9872342b5b69 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.455487] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-7513d9b0-3021-45e2-8bc3-9872342b5b69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.455609] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-7513d9b0-3021-45e2-8bc3-9872342b5b69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.456748] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-7513d9b0-3021-45e2-8bc3-9872342b5b69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.456999] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7513d9b0-3021-45e2-8bc3-9872342b5b69',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.574485] env[69637]: INFO networking_nsxv3.common.synchronization [req-e3edac9e-3ee1-437a-a004-8910e972e3cd req-31a85272-4e7c-4ed4-9194-1828e025de88 service nova] Enqueued Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_rules [ 653.574743] env[69637]: INFO networking_nsxv3.common.synchronization [req-e3edac9e-3ee1-437a-a004-8910e972e3cd req-31a85272-4e7c-4ed4-9194-1828e025de88 service nova] Enqueued Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_members [ 653.574937] env[69637]: INFO networking_nsxv3.common.synchronization [req-e3edac9e-3ee1-437a-a004-8910e972e3cd req-31a85272-4e7c-4ed4-9194-1828e025de88 service nova] Enqueued Resource ID: 77bed287-a877-43a4-afb4-be2b0c2e5aa1 with Priority: HIGHEST for action port [ 653.576029] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_rules [ 653.576298] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_members [ 653.576448] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77bed287-a877-43a4-afb4-be2b0c2e5aa1 with Priority: HIGHEST for action port [ 653.576837] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-645e75b0-47c9-44b7-81c7-713e50cf04dc taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.576985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.577049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.577299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.577382] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.578604] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-645e75b0-47c9-44b7-81c7-713e50cf04dc taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.578736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.578787] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.578954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.579739] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.579857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.579927] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.580528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.580607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.580706] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.581663] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-77bed287-a877-43a4-afb4-be2b0c2e5aa1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.581779] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77bed287-a877-43a4-afb4-be2b0c2e5aa1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.581779] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77bed287-a877-43a4-afb4-be2b0c2e5aa1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.584255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77bed287-a877-43a4-afb4-be2b0c2e5aa1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.584350] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77bed287-a877-43a4-afb4-be2b0c2e5aa1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.960418] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.960780] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.960780] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.961137] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.961252] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.962680] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 7513d9b0-3021-45e2-8bc3-9872342b5b69 not found, creating... [ 653.962680] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.962680] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.963086] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.963086] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.964355] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.964355] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.964355] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.964355] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.964355] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.964355] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.964543] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 7513d9b0-3021-45e2-8bc3-9872342b5b69 is going to be created. [ 653.985334] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.985334] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.985744] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.985744] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.985909] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.986094] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-7513d9b0-3021-45e2-8bc3-9872342b5b69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.089022] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-645e75b0-47c9-44b7-81c7-713e50cf04dc taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.089022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.089022] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.089022] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77bed287-a877-43a4-afb4-be2b0c2e5aa1 with status ACTIVE [ 654.089022] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.089022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.089022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.089022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.089022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.089022] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.089022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.089022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.089022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.089022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.091944] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.092331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.094024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.094024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.094024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.094024] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77bed287-a877-43a4-afb4-be2b0c2e5aa1 is going to be updated. [ 654.117543] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.117679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.117679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.117878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.118028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.118212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77bed287-a877-43a4-afb4-be2b0c2e5aa1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.596120] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.987386] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb in Status: SUCCESS [ 654.987664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.987664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.988237] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.988237] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.988237] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.988237] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.988591] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.988676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.988767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.988895] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d9cb429-99aa-4837-be4a-8fc93149f9fb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.057368] env[69637]: INFO networking_nsxv3.common.synchronization [None req-c2afb88d-04c1-4867-97af-41679ec0b1ef None None] Enqueued Resource ID: 8e1b09cb-2176-4287-96fd-07be6dcee637 with Priority: HIGHEST for action port [ 655.057415] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1b09cb-2176-4287-96fd-07be6dcee637 with Priority: HIGHEST for action port [ 655.062316] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e1b09cb-2176-4287-96fd-07be6dcee637 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.062316] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e1b09cb-2176-4287-96fd-07be6dcee637" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.062316] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e1b09cb-2176-4287-96fd-07be6dcee637" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.062316] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e1b09cb-2176-4287-96fd-07be6dcee637" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.062316] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e1b09cb-2176-4287-96fd-07be6dcee637',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.098188] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.100066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.100066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.100066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.100066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.100066] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc is going to be created. [ 655.121817] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.121817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.121817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.121817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.122238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.130449] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc in Status: UNINITIALIZED for 2s [ 655.227488] env[69637]: INFO networking_nsxv3.common.synchronization [None req-882a49c6-1a73-4a5d-9489-35c7abfc7f86 None None] Enqueued Resource ID: 68061ca7-7d28-48b4-8347-d078295be142 with Priority: HIGHEST for action port [ 655.227539] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68061ca7-7d28-48b4-8347-d078295be142 with Priority: HIGHEST for action port [ 655.228087] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-68061ca7-7d28-48b4-8347-d078295be142 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.228211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68061ca7-7d28-48b4-8347-d078295be142" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.228283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68061ca7-7d28-48b4-8347-d078295be142" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.228630] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68061ca7-7d28-48b4-8347-d078295be142" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.228630] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68061ca7-7d28-48b4-8347-d078295be142',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.492281] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d9cb429-99aa-4837-be4a-8fc93149f9fb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.562316] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e1b09cb-2176-4287-96fd-07be6dcee637 [ 655.562521] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.562696] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.562803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.563098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.563199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.563713] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e1b09cb-2176-4287-96fd-07be6dcee637 already deleted. [ 655.563713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e1b09cb-2176-4287-96fd-07be6dcee637" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.731253] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68061ca7-7d28-48b4-8347-d078295be142 [ 655.731792] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.731792] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.731792] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.731938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.731981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.732222] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68061ca7-7d28-48b4-8347-d078295be142 already deleted. [ 655.732222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68061ca7-7d28-48b4-8347-d078295be142" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.996175] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d9cb429-99aa-4837-be4a-8fc93149f9fb: rpc.has_security_group_logging(os_id): False [ 656.017391] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.017391] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.017581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.017655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.017876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.017982] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.018082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.018185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.018736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.018736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.018736] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb is going to be created. [ 656.079915] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.080133] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.080133] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.080520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.080520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.114087] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb in Status: IN_PROGRESS for 2s [ 656.379122] env[69637]: INFO networking_nsxv3.common.synchronization [req-88d8631d-b533-4c11-86d2-643901a0f884 req-041b68ea-edcf-4bb0-94ea-4c249940e138 service nova] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_rules [ 656.379122] env[69637]: INFO networking_nsxv3.common.synchronization [req-88d8631d-b533-4c11-86d2-643901a0f884 req-041b68ea-edcf-4bb0-94ea-4c249940e138 service nova] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 656.379122] env[69637]: INFO networking_nsxv3.common.synchronization [req-88d8631d-b533-4c11-86d2-643901a0f884 req-041b68ea-edcf-4bb0-94ea-4c249940e138 service nova] Enqueued Resource ID: 7513d9b0-3021-45e2-8bc3-9872342b5b69 with Priority: HIGHEST for action port [ 656.379473] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_rules [ 656.379706] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 656.379969] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7513d9b0-3021-45e2-8bc3-9872342b5b69 with Priority: HIGHEST for action port [ 656.380392] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.380719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.380875] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.381238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.381546] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.385568] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.385568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.385568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.385568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.385568] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.385568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.385568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.385568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.385568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.385568] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.389825] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-7513d9b0-3021-45e2-8bc3-9872342b5b69 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.389825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7513d9b0-3021-45e2-8bc3-9872342b5b69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.389825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7513d9b0-3021-45e2-8bc3-9872342b5b69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.389825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7513d9b0-3021-45e2-8bc3-9872342b5b69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.389825] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7513d9b0-3021-45e2-8bc3-9872342b5b69',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.678535] env[69637]: INFO networking_nsxv3.common.synchronization [None req-8906b4b0-7cf8-45ee-95e1-70742ff38904 None None] Enqueued Resource ID: 8a5b7853-9f04-4bd1-ac04-cb68e8b9633a with Priority: HIGHEST for action port [ 656.679122] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a5b7853-9f04-4bd1-ac04-cb68e8b9633a with Priority: HIGHEST for action port [ 656.679369] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a5b7853-9f04-4bd1-ac04-cb68e8b9633a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.679507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a5b7853-9f04-4bd1-ac04-cb68e8b9633a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.679576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a5b7853-9f04-4bd1-ac04-cb68e8b9633a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.679798] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a5b7853-9f04-4bd1-ac04-cb68e8b9633a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.680243] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a5b7853-9f04-4bd1-ac04-cb68e8b9633a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.891804] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.894340] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.894340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.894340] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7513d9b0-3021-45e2-8bc3-9872342b5b69 with status ACTIVE [ 656.894340] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.894340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.894340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.894645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.894645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.894645] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.894897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.894897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.895009] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.895739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.896015] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.896200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.896200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.896394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.896525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.896614] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7513d9b0-3021-45e2-8bc3-9872342b5b69 is going to be updated. [ 656.899986] env[69637]: INFO networking_nsxv3.common.synchronization [req-de08ecd3-c040-4663-a37a-8f9d25d98038 req-d1a4b92d-acce-4ca1-9d45-fa9878faab18 tempest-VolumesAdminNegativeTest-82035611 tempest-VolumesAdminNegativeTest-82035611-project-member] Enqueued Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGHEST for action security_group_members [ 656.901232] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGHEST for action security_group_members [ 656.901985] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ebf57d6-6da5-49a3-83b3-8e08d42464db taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.901985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.901985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.901985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.902286] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.902286] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.902286] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.902602] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.902602] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.902602] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ebf57d6-6da5-49a3-83b3-8e08d42464db',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.918966] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.919246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.919246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.919441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.919581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.919761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7513d9b0-3021-45e2-8bc3-9872342b5b69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.163648] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc in Status: UNINITIALIZED for 4s [ 657.186350] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a5b7853-9f04-4bd1-ac04-cb68e8b9633a [ 657.186350] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.186350] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.186350] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.186350] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.186350] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.186350] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a5b7853-9f04-4bd1-ac04-cb68e8b9633a already deleted. [ 657.186350] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a5b7853-9f04-4bd1-ac04-cb68e8b9633a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.399555] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.408412] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.408412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.408412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.408412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.408412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.408412] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.408412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.408412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.408412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.408412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.408412] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db already deleted. [ 657.408412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.466513] env[69637]: INFO networking_nsxv3.common.synchronization [None req-8b3141ec-2716-4a21-b2b8-c82e9112e51b None None] Enqueued Resource ID: 3c81da13-dd6f-4ee7-bc01-5629414471dd with Priority: HIGHEST for action port [ 657.466513] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c81da13-dd6f-4ee7-bc01-5629414471dd with Priority: HIGHEST for action port [ 657.467283] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c81da13-dd6f-4ee7-bc01-5629414471dd taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.467488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c81da13-dd6f-4ee7-bc01-5629414471dd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.467610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c81da13-dd6f-4ee7-bc01-5629414471dd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.468173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c81da13-dd6f-4ee7-bc01-5629414471dd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.468726] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c81da13-dd6f-4ee7-bc01-5629414471dd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.903394] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.903394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.903394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.903394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.903394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.903394] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be created. [ 657.927083] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.927083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.927083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.927577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.927577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.947131] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: UNINITIALIZED for 2s [ 657.973455] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c81da13-dd6f-4ee7-bc01-5629414471dd [ 657.973730] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.973885] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.973957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.974269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.974368] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.974466] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c81da13-dd6f-4ee7-bc01-5629414471dd already deleted. [ 657.974553] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c81da13-dd6f-4ee7-bc01-5629414471dd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.127106] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb in Status: SUCCESS [ 658.127407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.766395] env[69637]: INFO networking_nsxv3.common.synchronization [None req-96a9af5d-f298-4964-9fc1-d94013f4e7c5 None None] Enqueued Resource ID: 434e34ae-d7fa-43c7-8ef5-002adac252c7 with Priority: HIGHEST for action port [ 658.769490] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 434e34ae-d7fa-43c7-8ef5-002adac252c7 with Priority: HIGHEST for action port [ 658.769490] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-434e34ae-d7fa-43c7-8ef5-002adac252c7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.769490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-434e34ae-d7fa-43c7-8ef5-002adac252c7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.769490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-434e34ae-d7fa-43c7-8ef5-002adac252c7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.769490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-434e34ae-d7fa-43c7-8ef5-002adac252c7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.770215] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('434e34ae-d7fa-43c7-8ef5-002adac252c7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.886329] env[69637]: INFO networking_nsxv3.common.synchronization [None req-0266f9a2-144e-4861-a98b-07c535151c37 None None] Enqueued Resource ID: 304ed595-9f52-4125-99ae-a6f400fc2851 with Priority: HIGHEST for action port [ 658.888175] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 304ed595-9f52-4125-99ae-a6f400fc2851 with Priority: HIGHEST for action port [ 658.888175] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-304ed595-9f52-4125-99ae-a6f400fc2851 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.888175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-304ed595-9f52-4125-99ae-a6f400fc2851" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.888175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-304ed595-9f52-4125-99ae-a6f400fc2851" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.888667] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-304ed595-9f52-4125-99ae-a6f400fc2851" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.889054] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('304ed595-9f52-4125-99ae-a6f400fc2851',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.174445] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc in Status: SUCCESS [ 659.174777] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.175405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.175644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.176737] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.176737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.176737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.176737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.176737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.176737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.176737] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.272038] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 434e34ae-d7fa-43c7-8ef5-002adac252c7 [ 659.273368] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.273515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.273582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.273787] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.273873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.273964] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:434e34ae-d7fa-43c7-8ef5-002adac252c7 already deleted. [ 659.274052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-434e34ae-d7fa-43c7-8ef5-002adac252c7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.319475] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-234 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.319706] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.319942] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.320271] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.320429] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.320574] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.320705] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.320915] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.321082] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.321292] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.321412] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.321551] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.321671] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.321783] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.321889] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.322033] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.344065] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.344065] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 659.344065] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.344065] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.344065] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-8ec8f702-0a56-496f-8daf-25a74b6b039b taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.344065] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-8ec8f702-0a56-496f-8daf-25a74b6b039b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.344065] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-8ec8f702-0a56-496f-8daf-25a74b6b039b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.344355] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-8ec8f702-0a56-496f-8daf-25a74b6b039b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.344940] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ec8f702-0a56-496f-8daf-25a74b6b039b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.391318] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 304ed595-9f52-4125-99ae-a6f400fc2851 [ 659.391570] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.391717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.391799] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.393201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.393201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.393201] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:304ed595-9f52-4125-99ae-a6f400fc2851 already deleted. [ 659.393201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-304ed595-9f52-4125-99ae-a6f400fc2851" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.680278] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-645e75b0-47c9-44b7-81c7-713e50cf04dc taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.680278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.680278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.680419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.680781] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.680781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.680781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.681044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.681044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.681044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.681456] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-645e75b0-47c9-44b7-81c7-713e50cf04dc taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.681456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.681456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.681456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.682274] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.682274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.682274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.682274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.682274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.682274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.682274] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.847464] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.848655] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.848839] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.849122] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.849278] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.849454] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 8ec8f702-0a56-496f-8daf-25a74b6b039b not found, creating... [ 659.849738] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.849907] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.850097] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.853399] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.854393] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.854393] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.856422] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.856422] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.856422] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.856422] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.856422] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 8ec8f702-0a56-496f-8daf-25a74b6b039b is going to be created. [ 659.880375] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.880375] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.880375] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.880375] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.880375] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.880375] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-8ec8f702-0a56-496f-8daf-25a74b6b039b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.960331] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 659.962771] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.962771] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.962771] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.962771] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.962771] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.962771] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.962771] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.962771] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.962771] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.962771] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.190386] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 645e75b0-47c9-44b7-81c7-713e50cf04dc: rpc.has_security_group_logging(os_id): False [ 660.211438] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.211631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.211699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.212105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.212197] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.212424] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.212528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.212603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.212787] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.212882] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.214016] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.214016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.214016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.214016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.214016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.214016] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.214016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.214016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.214016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.214016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.214016] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc is going to be created. [ 660.277087] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.277330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.277484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.277712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.278552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.293333] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc in Status: IN_PROGRESS for 2s [ 660.466154] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.466310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.466425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.466623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.466783] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.467054] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.467201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.467355] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.467443] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.467539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.467706] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.467766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.467828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.468083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.468142] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.468351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.468351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.468413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.468497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.468585] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.468672] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.971536] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc8c512a-6092-4e87-9d42-efdd0a8ab3f4: rpc.has_security_group_logging(os_id): False [ 660.978065] env[69637]: INFO networking_nsxv3.common.synchronization [None req-916402a7-56e0-4d2b-bca1-7d0b255382a3 None None] Enqueued Resource ID: d091224d-cbd1-4c20-a9ae-a7f6faddc9eb with Priority: HIGHEST for action port [ 660.978177] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d091224d-cbd1-4c20-a9ae-a7f6faddc9eb with Priority: HIGHEST for action port [ 660.978721] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-d091224d-cbd1-4c20-a9ae-a7f6faddc9eb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.978849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d091224d-cbd1-4c20-a9ae-a7f6faddc9eb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.978895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d091224d-cbd1-4c20-a9ae-a7f6faddc9eb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.979163] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d091224d-cbd1-4c20-a9ae-a7f6faddc9eb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.979234] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d091224d-cbd1-4c20-a9ae-a7f6faddc9eb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.994226] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.994226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.994226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.994226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.994226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.994226] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.994226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.994226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.994226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.994226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.994226] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.994226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.994226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.994226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.994226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.995086] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.995086] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.995086] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.995086] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.995086] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.995086] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be created. [ 661.051387] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.051387] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.051387] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.051387] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.051387] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.074644] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 661.371870] env[69637]: INFO networking_nsxv3.common.synchronization [None req-6033119d-dc5c-460d-a67b-14fcb31c3262 None None] Enqueued Resource ID: 77876df0-4544-4637-b170-599cbb9cff9e with Priority: HIGHEST for action port [ 661.372143] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77876df0-4544-4637-b170-599cbb9cff9e with Priority: HIGHEST for action port [ 661.372936] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-77876df0-4544-4637-b170-599cbb9cff9e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.372936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77876df0-4544-4637-b170-599cbb9cff9e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.373264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77876df0-4544-4637-b170-599cbb9cff9e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.373264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77876df0-4544-4637-b170-599cbb9cff9e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.373615] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77876df0-4544-4637-b170-599cbb9cff9e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.483785] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d091224d-cbd1-4c20-a9ae-a7f6faddc9eb [ 661.483961] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.484156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.484211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.484465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.484547] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.484613] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d091224d-cbd1-4c20-a9ae-a7f6faddc9eb already deleted. [ 661.484694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d091224d-cbd1-4c20-a9ae-a7f6faddc9eb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.623102] env[69637]: INFO networking_nsxv3.common.synchronization [None req-0d048b9e-fa60-49ea-b9f5-ae80cc2cd393 None None] Enqueued Resource ID: 896ee2c1-2f83-43e9-b128-4163de1250f7 with Priority: HIGHEST for action port [ 661.623102] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 896ee2c1-2f83-43e9-b128-4163de1250f7 with Priority: HIGHEST for action port [ 661.623102] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-896ee2c1-2f83-43e9-b128-4163de1250f7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.623978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-896ee2c1-2f83-43e9-b128-4163de1250f7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.624320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-896ee2c1-2f83-43e9-b128-4163de1250f7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.624710] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-896ee2c1-2f83-43e9-b128-4163de1250f7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.624923] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('896ee2c1-2f83-43e9-b128-4163de1250f7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.875723] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77876df0-4544-4637-b170-599cbb9cff9e [ 661.875955] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.876185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.876185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.876570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.876570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.876570] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77876df0-4544-4637-b170-599cbb9cff9e already deleted. [ 661.876656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77876df0-4544-4637-b170-599cbb9cff9e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.064342] env[69637]: INFO networking_nsxv3.common.synchronization [req-de08ecd3-c040-4663-a37a-8f9d25d98038 req-0b50a769-1b76-4d87-9fba-62777e7e2bfe service nova] Enqueued Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGHEST for action security_group_rules [ 662.064630] env[69637]: INFO networking_nsxv3.common.synchronization [req-de08ecd3-c040-4663-a37a-8f9d25d98038 req-0b50a769-1b76-4d87-9fba-62777e7e2bfe service nova] Enqueued Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGHEST for action security_group_members [ 662.064698] env[69637]: INFO networking_nsxv3.common.synchronization [req-de08ecd3-c040-4663-a37a-8f9d25d98038 req-0b50a769-1b76-4d87-9fba-62777e7e2bfe service nova] Enqueued Resource ID: 8ec8f702-0a56-496f-8daf-25a74b6b039b with Priority: HIGHEST for action port [ 662.064940] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGHEST for action security_group_rules [ 662.065081] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGHEST for action security_group_members [ 662.065187] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ec8f702-0a56-496f-8daf-25a74b6b039b with Priority: HIGHEST for action port [ 662.065786] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.066066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.066066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.069690] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.069786] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ebf57d6-6da5-49a3-83b3-8e08d42464db',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.071858] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ebf57d6-6da5-49a3-83b3-8e08d42464db taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.071858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.071858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.071858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.071858] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.071858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.071858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.072505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.072505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.072505] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ebf57d6-6da5-49a3-83b3-8e08d42464db',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.076324] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ec8f702-0a56-496f-8daf-25a74b6b039b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.076533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ec8f702-0a56-496f-8daf-25a74b6b039b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.076533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ec8f702-0a56-496f-8daf-25a74b6b039b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.076897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ec8f702-0a56-496f-8daf-25a74b6b039b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.076897] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ec8f702-0a56-496f-8daf-25a74b6b039b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.127906] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 896ee2c1-2f83-43e9-b128-4163de1250f7 [ 662.128269] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.128421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.128493] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.132282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.132414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.132528] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:896ee2c1-2f83-43e9-b128-4163de1250f7 already deleted. [ 662.132627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-896ee2c1-2f83-43e9-b128-4163de1250f7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.307414] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc in Status: SUCCESS [ 662.307414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.412072] env[69637]: INFO networking_nsxv3.common.synchronization [None req-7aa54505-f7c1-405d-a0d6-33168a0a83c3 None None] Enqueued Resource ID: 259a50fd-34d6-4266-a53f-c6f757a6661a with Priority: HIGHEST for action port [ 662.412202] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 259a50fd-34d6-4266-a53f-c6f757a6661a with Priority: HIGHEST for action port [ 662.412764] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-259a50fd-34d6-4266-a53f-c6f757a6661a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.412910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-259a50fd-34d6-4266-a53f-c6f757a6661a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.412978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-259a50fd-34d6-4266-a53f-c6f757a6661a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.417359] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-259a50fd-34d6-4266-a53f-c6f757a6661a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.419021] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('259a50fd-34d6-4266-a53f-c6f757a6661a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.545312] env[69637]: INFO networking_nsxv3.common.synchronization [req-5004851a-5548-49b3-8234-26d3aa1e1a12 req-fe7b6f59-b2cd-4f67-9b6c-a70bb1ece272 tempest-ImagesOneServerTestJSON-1562227752 tempest-ImagesOneServerTestJSON-1562227752-project-member] Enqueued Resource ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 with Priority: HIGHEST for action security_group_members [ 662.549873] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 with Priority: HIGHEST for action security_group_members [ 662.549873] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.549873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.550083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.550253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.550467] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.550467] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.550780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.550780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.550780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.551385] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e7e0a9c-c4a7-4666-a3e3-3138a89446e5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.582609] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ebf57d6-6da5-49a3-83b3-8e08d42464db taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.582609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.582609] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ebf57d6-6da5-49a3-83b3-8e08d42464db',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.582609] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ec8f702-0a56-496f-8daf-25a74b6b039b with status ACTIVE [ 662.582609] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.582609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.582609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.582609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.582609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.582609] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.582609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.582609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.582609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.582609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.583352] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.583352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.583352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.583352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.583352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.583352] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ec8f702-0a56-496f-8daf-25a74b6b039b is going to be updated. [ 662.609706] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.609706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.609706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.609706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.609706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.609706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ec8f702-0a56-496f-8daf-25a74b6b039b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.701289] env[69637]: INFO networking_nsxv3.common.synchronization [None req-7382d60f-4219-4432-b30d-098fa1c42649 tempest-ServersTestBootFromVolume-426522910 tempest-ServersTestBootFromVolume-426522910-project-member] Enqueued Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGHEST for action security_group_rules [ 662.701289] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGHEST for action security_group_rules [ 662.701697] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.701786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.701786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.703773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.703932] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fb52e9e-114d-48d5-9b9e-c3f299243e92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.921342] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 259a50fd-34d6-4266-a53f-c6f757a6661a [ 662.921342] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.921342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.921342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.921342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.921342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.921342] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:259a50fd-34d6-4266-a53f-c6f757a6661a already deleted. [ 662.921342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-259a50fd-34d6-4266-a53f-c6f757a6661a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.056214] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.056770] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.056770] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.056986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.057167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.057401] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.057559] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.057631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.057875] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.057993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.058170] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 already deleted. [ 663.058215] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.080157] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ebf57d6-6da5-49a3-83b3-8e08d42464db',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.088964] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 663.088964] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.204411] env[69637]: INFO networking_nsxv3.common.synchronization [None req-fd2b6e91-56db-434d-9e59-984353a5491e None None] Enqueued Resource ID: a648697f-5caa-41b5-9868-9f9036b9affa with Priority: HIGHEST for action port [ 663.205450] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a648697f-5caa-41b5-9868-9f9036b9affa with Priority: HIGHEST for action port [ 663.205450] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-a648697f-5caa-41b5-9868-9f9036b9affa taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.205450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a648697f-5caa-41b5-9868-9f9036b9affa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.205594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a648697f-5caa-41b5-9868-9f9036b9affa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.206700] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a648697f-5caa-41b5-9868-9f9036b9affa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.206700] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a648697f-5caa-41b5-9868-9f9036b9affa',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.228224] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.228605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.228605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.228787] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.228787] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.228885] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 already deleted. [ 663.229246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.410142] env[69637]: INFO networking_nsxv3.common.synchronization [None req-cf9b6188-dd0a-43d6-8ff4-d33160c9715f None None] Enqueued Resource ID: 49b2f849-8493-4f69-ab1b-ff283b4ffe31 with Priority: HIGHEST for action port [ 663.410142] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b2f849-8493-4f69-ab1b-ff283b4ffe31 with Priority: HIGHEST for action port [ 663.410370] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-49b2f849-8493-4f69-ab1b-ff283b4ffe31 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.410429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49b2f849-8493-4f69-ab1b-ff283b4ffe31" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.410562] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49b2f849-8493-4f69-ab1b-ff283b4ffe31" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.410796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49b2f849-8493-4f69-ab1b-ff283b4ffe31" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.410880] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49b2f849-8493-4f69-ab1b-ff283b4ffe31',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.583650] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.584776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.584776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.584776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.584776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.584776] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db is going to be created. [ 663.607975] env[69637]: INFO networking_nsxv3.common.synchronization [None req-1f006923-3bf8-4540-ba23-70db6095661e tempest-ServersTestBootFromVolume-426522910 tempest-ServersTestBootFromVolume-426522910-project-member] Enqueued Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGHEST for action security_group_rules [ 663.612454] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.612855] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.612855] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.613313] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.613416] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.615304] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGHEST for action security_group_rules [ 663.617693] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.617693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.617693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.617693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.617693] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fb52e9e-114d-48d5-9b9e-c3f299243e92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.625260] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db in Status: UNINITIALIZED for 2s [ 663.712626] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a648697f-5caa-41b5-9868-9f9036b9affa [ 663.712747] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.713919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.713919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.713919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.713919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.713919] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a648697f-5caa-41b5-9868-9f9036b9affa already deleted. [ 663.713919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a648697f-5caa-41b5-9868-9f9036b9affa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.913156] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49b2f849-8493-4f69-ab1b-ff283b4ffe31 [ 663.913387] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.913520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.913590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.913799] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.913890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.913984] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49b2f849-8493-4f69-ab1b-ff283b4ffe31 already deleted. [ 663.914094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49b2f849-8493-4f69-ab1b-ff283b4ffe31" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.138365] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.138675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.138675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.138777] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.138863] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.138953] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 already deleted. [ 664.139043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.478668] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-143 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.478865] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-143" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.479034] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-143" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.479646] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-143" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.480054] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.480232] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.480370] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.484284] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.484810] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.484810] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.484810] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.484980] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.485037] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.485135] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.485244] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.485393] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.503984] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.504170] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 664.504358] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.504502] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-143" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.505019] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-f7f8e4ee-cea8-4f0f-9821-965c448076d5 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.505019] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-f7f8e4ee-cea8-4f0f-9821-965c448076d5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.505167] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-f7f8e4ee-cea8-4f0f-9821-965c448076d5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.505545] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-f7f8e4ee-cea8-4f0f-9821-965c448076d5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.505592] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7f8e4ee-cea8-4f0f-9821-965c448076d5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.698611] env[69637]: INFO networking_nsxv3.common.synchronization [None req-f90799cb-215f-480d-a19f-76aa1cd0d501 None None] Enqueued Resource ID: f906533c-d795-4878-b4e6-dc73b8c8ee16 with Priority: HIGHEST for action port [ 664.698823] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f906533c-d795-4878-b4e6-dc73b8c8ee16 with Priority: HIGHEST for action port [ 664.699411] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-f906533c-d795-4878-b4e6-dc73b8c8ee16 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.699840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f906533c-d795-4878-b4e6-dc73b8c8ee16" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.699914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f906533c-d795-4878-b4e6-dc73b8c8ee16" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.700433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f906533c-d795-4878-b4e6-dc73b8c8ee16" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.700554] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f906533c-d795-4878-b4e6-dc73b8c8ee16',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.008754] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.009353] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.009488] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.009774] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.009931] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.010097] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port f7f8e4ee-cea8-4f0f-9821-965c448076d5 not found, creating... [ 665.011352] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.011352] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.011352] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.011352] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.012504] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.012908] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.013102] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.014216] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.014216] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.014216] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.014216] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: f7f8e4ee-cea8-4f0f-9821-965c448076d5 is going to be created. [ 665.035632] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.035632] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.035632] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.035632] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.036401] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.036401] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-f7f8e4ee-cea8-4f0f-9821-965c448076d5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.089605] env[69637]: INFO networking_nsxv3.common.synchronization [None req-35136600-b7f7-4adf-8439-1ce43255472f None None] Enqueued Resource ID: 8139b5ef-3299-4aee-ba02-5990bb6ae38d with Priority: HIGHEST for action port [ 665.089874] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8139b5ef-3299-4aee-ba02-5990bb6ae38d with Priority: HIGHEST for action port [ 665.090451] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-8139b5ef-3299-4aee-ba02-5990bb6ae38d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.090752] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8139b5ef-3299-4aee-ba02-5990bb6ae38d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.090752] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8139b5ef-3299-4aee-ba02-5990bb6ae38d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.090937] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8139b5ef-3299-4aee-ba02-5990bb6ae38d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.091205] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8139b5ef-3299-4aee-ba02-5990bb6ae38d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.205874] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f906533c-d795-4878-b4e6-dc73b8c8ee16 [ 665.206168] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.206636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.206750] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.206999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.207153] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.209022] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f906533c-d795-4878-b4e6-dc73b8c8ee16 already deleted. [ 665.209022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f906533c-d795-4878-b4e6-dc73b8c8ee16" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.593823] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8139b5ef-3299-4aee-ba02-5990bb6ae38d [ 665.593823] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.593823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.593823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.594420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.594420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.594420] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8139b5ef-3299-4aee-ba02-5990bb6ae38d already deleted. [ 665.594420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8139b5ef-3299-4aee-ba02-5990bb6ae38d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.634547] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db in Status: SUCCESS [ 665.634939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.635216] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.635431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.635627] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.635747] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.636060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.636060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.636060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.636188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.636230] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ebf57d6-6da5-49a3-83b3-8e08d42464db',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.140909] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ebf57d6-6da5-49a3-83b3-8e08d42464db',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.359428] env[69637]: INFO networking_nsxv3.common.synchronization [None req-dcc7053d-2c8e-4375-8846-c2753a32ca42 None None] Enqueued Resource ID: 2d6c3a56-f461-45e9-bcda-cca36c73c04e with Priority: HIGHEST for action port [ 666.360302] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d6c3a56-f461-45e9-bcda-cca36c73c04e with Priority: HIGHEST for action port [ 666.361175] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d6c3a56-f461-45e9-bcda-cca36c73c04e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.361286] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d6c3a56-f461-45e9-bcda-cca36c73c04e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.361361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d6c3a56-f461-45e9-bcda-cca36c73c04e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.361727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d6c3a56-f461-45e9-bcda-cca36c73c04e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.362933] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d6c3a56-f461-45e9-bcda-cca36c73c04e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.644211] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ebf57d6-6da5-49a3-83b3-8e08d42464db: rpc.has_security_group_logging(os_id): False [ 666.662386] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.662960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.662960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.662960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.662960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.663233] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.663304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.663347] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.663550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.663630] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.663730] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db is going to be created. [ 666.718396] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.718556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.718636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.718859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.719081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.730429] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db in Status: IN_PROGRESS for 2s [ 666.866058] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d6c3a56-f461-45e9-bcda-cca36c73c04e [ 666.867055] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.867055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.867055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.867055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.867055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.867401] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d6c3a56-f461-45e9-bcda-cca36c73c04e already deleted. [ 666.867541] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d6c3a56-f461-45e9-bcda-cca36c73c04e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.955034] env[69637]: INFO networking_nsxv3.common.synchronization [None req-ef67b78e-a8f0-43c8-b91e-e07ab1ef7449 None None] Enqueued Resource ID: a9c4481d-44d9-47e8-8e7c-54d2c4eaf2ea with Priority: HIGHEST for action port [ 666.955034] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9c4481d-44d9-47e8-8e7c-54d2c4eaf2ea with Priority: HIGHEST for action port [ 666.955165] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9c4481d-44d9-47e8-8e7c-54d2c4eaf2ea taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.955230] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9c4481d-44d9-47e8-8e7c-54d2c4eaf2ea" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.955267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9c4481d-44d9-47e8-8e7c-54d2c4eaf2ea" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.956520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9c4481d-44d9-47e8-8e7c-54d2c4eaf2ea" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.956520] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9c4481d-44d9-47e8-8e7c-54d2c4eaf2ea',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.072958] env[69637]: INFO networking_nsxv3.common.synchronization [req-a14ddb9e-3dd2-483b-87f4-b323425d96d9 req-af8d0cc6-a7c0-4c96-9982-4373448443e6 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 2bea8a67-35df-45be-bf57-95c80494d7fe with Priority: HIGHEST for action security_group_members [ 667.073775] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bea8a67-35df-45be-bf57-95c80494d7fe with Priority: HIGHEST for action security_group_members [ 667.073824] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bea8a67-35df-45be-bf57-95c80494d7fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.074033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.074033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.076478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.076665] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.076782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.076846] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.077027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.077132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.077371] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bea8a67-35df-45be-bf57-95c80494d7fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.236424] env[69637]: INFO networking_nsxv3.common.synchronization [req-5004851a-5548-49b3-8234-26d3aa1e1a12 req-b3345b26-7a37-4756-b670-98e8c76a2a07 service nova] Enqueued Resource ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 with Priority: HIGHEST for action security_group_rules [ 667.236615] env[69637]: INFO networking_nsxv3.common.synchronization [req-5004851a-5548-49b3-8234-26d3aa1e1a12 req-b3345b26-7a37-4756-b670-98e8c76a2a07 service nova] Enqueued Resource ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 with Priority: HIGHEST for action security_group_members [ 667.236755] env[69637]: INFO networking_nsxv3.common.synchronization [req-5004851a-5548-49b3-8234-26d3aa1e1a12 req-b3345b26-7a37-4756-b670-98e8c76a2a07 service nova] Enqueued Resource ID: f7f8e4ee-cea8-4f0f-9821-965c448076d5 with Priority: HIGHEST for action port [ 667.237049] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 with Priority: HIGHEST for action security_group_rules [ 667.237285] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 with Priority: HIGHEST for action security_group_members [ 667.237360] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7f8e4ee-cea8-4f0f-9821-965c448076d5 with Priority: HIGHEST for action port [ 667.238154] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.238733] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.238823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.241492] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.241492] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e7e0a9c-c4a7-4666-a3e3-3138a89446e5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.242286] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.242385] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.242429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.242594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.242747] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.242994] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.242994] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.243112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.243834] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.243834] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e7e0a9c-c4a7-4666-a3e3-3138a89446e5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.245554] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7f8e4ee-cea8-4f0f-9821-965c448076d5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.245692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7f8e4ee-cea8-4f0f-9821-965c448076d5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.245763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7f8e4ee-cea8-4f0f-9821-965c448076d5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.246162] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7f8e4ee-cea8-4f0f-9821-965c448076d5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.246162] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7f8e4ee-cea8-4f0f-9821-965c448076d5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.318587] env[69637]: INFO networking_nsxv3.common.synchronization [None req-b5affe84-8bd5-4e1f-96d3-97944ffb8034 tempest-VolumesAssistedSnapshotsTest-1383698631 tempest-VolumesAssistedSnapshotsTest-1383698631-project-member] Enqueued Resource ID: 67b79615-8ab9-4c90-bd99-6702f487431a with Priority: HIGHEST for action security_group_rules [ 667.318896] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b79615-8ab9-4c90-bd99-6702f487431a with Priority: HIGHEST for action security_group_rules [ 667.320452] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67b79615-8ab9-4c90-bd99-6702f487431a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.320826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.321061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.321443] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.321677] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67b79615-8ab9-4c90-bd99-6702f487431a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.460210] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9c4481d-44d9-47e8-8e7c-54d2c4eaf2ea [ 667.460210] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.460210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.460876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.460990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.461089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.461207] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9c4481d-44d9-47e8-8e7c-54d2c4eaf2ea already deleted. [ 667.461663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9c4481d-44d9-47e8-8e7c-54d2c4eaf2ea" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.579549] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.579549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.579549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.579895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.580183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.580388] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.580555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.580610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.581267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.581267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.581267] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bea8a67-35df-45be-bf57-95c80494d7fe already deleted. [ 667.581267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.670806] env[69637]: INFO networking_nsxv3.common.synchronization [None req-11385b76-fbc9-48ea-9f94-ad14a30f3822 tempest-ServersTestManualDisk-188734878 tempest-ServersTestManualDisk-188734878-project-member] Enqueued Resource ID: 71aadb5f-78e6-44ce-b947-3707467a678d with Priority: HIGHEST for action security_group_rules [ 667.670806] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aadb5f-78e6-44ce-b947-3707467a678d with Priority: HIGHEST for action security_group_rules [ 667.670806] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71aadb5f-78e6-44ce-b947-3707467a678d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.670806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.670806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.671573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.671786] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71aadb5f-78e6-44ce-b947-3707467a678d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.719142] env[69637]: INFO networking_nsxv3.common.synchronization [None req-6bd70fa3-bcb6-4a60-8616-96c41f4bc7bd tempest-VolumesAssistedSnapshotsTest-1383698631 tempest-VolumesAssistedSnapshotsTest-1383698631-project-member] Enqueued Resource ID: 67b79615-8ab9-4c90-bd99-6702f487431a with Priority: HIGHEST for action security_group_rules [ 667.719848] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b79615-8ab9-4c90-bd99-6702f487431a with Priority: HIGHEST for action security_group_rules [ 667.722233] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67b79615-8ab9-4c90-bd99-6702f487431a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.722341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.748341] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e7e0a9c-c4a7-4666-a3e3-3138a89446e5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.749343] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.749458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.749605] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7f8e4ee-cea8-4f0f-9821-965c448076d5 with status ACTIVE [ 667.749762] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.749861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.749919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.750145] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.750241] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.750385] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.750493] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.750588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.752389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.752389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.752389] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.754508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.754508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.754508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.754508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.754671] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7f8e4ee-cea8-4f0f-9821-965c448076d5 is going to be updated. [ 667.776136] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.776276] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.776343] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.776600] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.776684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.776836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7f8e4ee-cea8-4f0f-9821-965c448076d5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.840373] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.840582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.840626] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.840801] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.840882] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.840972] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67b79615-8ab9-4c90-bd99-6702f487431a already deleted. [ 667.842352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.842352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.842352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.842352] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67b79615-8ab9-4c90-bd99-6702f487431a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.063638] env[69637]: INFO networking_nsxv3.common.synchronization [None req-c2dd93fe-a93d-4bd0-8fd0-93a9f97a313e None None] Enqueued Resource ID: 7f228b5e-1cf0-410d-b27d-da2aa7d27c61 with Priority: HIGHEST for action port [ 668.063931] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f228b5e-1cf0-410d-b27d-da2aa7d27c61 with Priority: HIGHEST for action port [ 668.064445] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f228b5e-1cf0-410d-b27d-da2aa7d27c61 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.064584] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f228b5e-1cf0-410d-b27d-da2aa7d27c61" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.064645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f228b5e-1cf0-410d-b27d-da2aa7d27c61" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.064897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f228b5e-1cf0-410d-b27d-da2aa7d27c61" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.064991] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f228b5e-1cf0-410d-b27d-da2aa7d27c61',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.131338] env[69637]: INFO networking_nsxv3.common.synchronization [None req-907d6e9b-e7a6-4413-87b6-0a09174badc0 tempest-ServersTestManualDisk-188734878 tempest-ServersTestManualDisk-188734878-project-member] Enqueued Resource ID: 71aadb5f-78e6-44ce-b947-3707467a678d with Priority: HIGHEST for action security_group_rules [ 668.132065] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aadb5f-78e6-44ce-b947-3707467a678d with Priority: HIGHEST for action security_group_rules [ 668.132472] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71aadb5f-78e6-44ce-b947-3707467a678d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.132472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.195148] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.195148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.195345] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.199036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.199036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.199036] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71aadb5f-78e6-44ce-b947-3707467a678d already deleted. [ 668.199036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.199036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.199036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.199036] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71aadb5f-78e6-44ce-b947-3707467a678d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.215882] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-149 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.218466] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.218646] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.218970] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.220058] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.220058] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.220058] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.220058] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.220058] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.223589] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 668.223589] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.223589] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.223589] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.223589] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 668.223589] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.223589] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.240392] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.240655] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 668.240812] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.240992] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.241332] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-5f471eee-9a54-4a5a-af33-2144fa5ff2cd taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.241523] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-5f471eee-9a54-4a5a-af33-2144fa5ff2cd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.241672] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-5f471eee-9a54-4a5a-af33-2144fa5ff2cd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.242069] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-5f471eee-9a54-4a5a-af33-2144fa5ff2cd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.242174] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f471eee-9a54-4a5a-af33-2144fa5ff2cd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.257165] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e7e0a9c-c4a7-4666-a3e3-3138a89446e5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.363819] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.363983] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.364763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.364763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.364763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.364763] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67b79615-8ab9-4c90-bd99-6702f487431a already deleted. [ 668.364763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.569252] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f228b5e-1cf0-410d-b27d-da2aa7d27c61 [ 668.569252] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.569706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.569706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.569706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.569890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.569994] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f228b5e-1cf0-410d-b27d-da2aa7d27c61 already deleted. [ 668.570097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f228b5e-1cf0-410d-b27d-da2aa7d27c61" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.720659] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.720810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.720810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.721319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.722301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.722739] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71aadb5f-78e6-44ce-b947-3707467a678d already deleted. [ 668.722739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.742716] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db in Status: SUCCESS [ 668.742971] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.745165] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.745165] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.745440] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.745479] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.745610] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.745770] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 5f471eee-9a54-4a5a-af33-2144fa5ff2cd not found, creating... [ 668.746119] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.746946] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.746946] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.746946] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.746946] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.751748] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.751748] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.751748] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.751748] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.751748] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.751748] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 5f471eee-9a54-4a5a-af33-2144fa5ff2cd is going to be created. [ 668.760202] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.760731] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.760924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.761233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.761439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.761646] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 is going to be created. [ 668.791376] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.791877] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.791877] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.793427] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.793566] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.793733] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-5f471eee-9a54-4a5a-af33-2144fa5ff2cd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.813101] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.813101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.813101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.813101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.813101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.835854] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 in Status: UNINITIALIZED for 2s [ 669.059880] env[69637]: INFO networking_nsxv3.common.synchronization [None req-dddb4245-ff26-4d32-a24b-de32f4da9fa0 None None] Enqueued Resource ID: aa1430bd-9522-44e5-9908-ea759965e7b8 with Priority: HIGHEST for action port [ 669.060109] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1430bd-9522-44e5-9908-ea759965e7b8 with Priority: HIGHEST for action port [ 669.060722] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa1430bd-9522-44e5-9908-ea759965e7b8 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.061758] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa1430bd-9522-44e5-9908-ea759965e7b8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.061838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa1430bd-9522-44e5-9908-ea759965e7b8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.062334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa1430bd-9522-44e5-9908-ea759965e7b8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.062434] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa1430bd-9522-44e5-9908-ea759965e7b8',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.085198] env[69637]: INFO networking_nsxv3.common.synchronization [req-46d8d8fc-7fd2-4cee-beb9-cd97837df064 req-c62439dc-9724-4b8f-9524-debed1a45ed8 tempest-ServerExternalEventsTest-1178473512 tempest-ServerExternalEventsTest-1178473512-project-member] Enqueued Resource ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 with Priority: HIGHEST for action security_group_members [ 669.085721] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 with Priority: HIGHEST for action security_group_members [ 669.086237] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.086513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.086700] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.087419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.087690] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.088470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.088670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.088961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.089187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.089394] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2ec22d1-47af-4b01-875c-6ea44a1abaa3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.564246] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa1430bd-9522-44e5-9908-ea759965e7b8 [ 669.564498] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.564637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.564704] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.564933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.565055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.565164] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa1430bd-9522-44e5-9908-ea759965e7b8 already deleted. [ 669.565257] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa1430bd-9522-44e5-9908-ea759965e7b8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.568827] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.569010] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.569141] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.569701] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.569987] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.570148] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.570271] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.570555] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.570661] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.570869] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.570979] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.571122] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.571223] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.571334] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.571439] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.571596] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.590703] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.590703] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 669.590832] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.590893] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.591190] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-2ed09423-1183-42a3-a1e8-6cd5d637e03b taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.591356] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-2ed09423-1183-42a3-a1e8-6cd5d637e03b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.591475] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-2ed09423-1183-42a3-a1e8-6cd5d637e03b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.591787] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-2ed09423-1183-42a3-a1e8-6cd5d637e03b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.591936] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ed09423-1183-42a3-a1e8-6cd5d637e03b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.592817] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.592953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.593220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.593428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.593538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.593737] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.593854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.593921] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.594110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.598019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.598019] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 already deleted. [ 669.598019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.620311] env[69637]: INFO networking_nsxv3.common.synchronization [req-a14ddb9e-3dd2-483b-87f4-b323425d96d9 req-69999ff3-e0a5-41ac-97a9-d0aa15850ed1 service nova] Enqueued Resource ID: 2bea8a67-35df-45be-bf57-95c80494d7fe with Priority: HIGHEST for action security_group_rules [ 669.620486] env[69637]: INFO networking_nsxv3.common.synchronization [req-a14ddb9e-3dd2-483b-87f4-b323425d96d9 req-69999ff3-e0a5-41ac-97a9-d0aa15850ed1 service nova] Enqueued Resource ID: 2bea8a67-35df-45be-bf57-95c80494d7fe with Priority: HIGHEST for action security_group_members [ 669.620911] env[69637]: INFO networking_nsxv3.common.synchronization [req-a14ddb9e-3dd2-483b-87f4-b323425d96d9 req-69999ff3-e0a5-41ac-97a9-d0aa15850ed1 service nova] Enqueued Resource ID: 5f471eee-9a54-4a5a-af33-2144fa5ff2cd with Priority: HIGHEST for action port [ 669.621632] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bea8a67-35df-45be-bf57-95c80494d7fe with Priority: HIGHEST for action security_group_rules [ 669.621772] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bea8a67-35df-45be-bf57-95c80494d7fe with Priority: HIGHEST for action security_group_members [ 669.621880] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f471eee-9a54-4a5a-af33-2144fa5ff2cd with Priority: HIGHEST for action port [ 669.622217] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bea8a67-35df-45be-bf57-95c80494d7fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.622337] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.622401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.622594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.622689] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bea8a67-35df-45be-bf57-95c80494d7fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.623535] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bea8a67-35df-45be-bf57-95c80494d7fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.624422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.624644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.624899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.625109] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.625275] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.625378] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.625631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.625733] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.625868] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bea8a67-35df-45be-bf57-95c80494d7fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.626659] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f471eee-9a54-4a5a-af33-2144fa5ff2cd taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.627045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f471eee-9a54-4a5a-af33-2144fa5ff2cd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.628030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f471eee-9a54-4a5a-af33-2144fa5ff2cd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.628030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f471eee-9a54-4a5a-af33-2144fa5ff2cd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.628030] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f471eee-9a54-4a5a-af33-2144fa5ff2cd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.096439] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.096439] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.096541] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.096759] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.096909] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.097187] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 2ed09423-1183-42a3-a1e8-6cd5d637e03b not found, creating... [ 670.097496] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.101025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.101025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.101025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.101025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.101025] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.101025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.101025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.101025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.101025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.101025] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 2ed09423-1183-42a3-a1e8-6cd5d637e03b is going to be created. [ 670.124103] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.124103] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.124103] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.124103] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.124103] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.124103] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-2ed09423-1183-42a3-a1e8-6cd5d637e03b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.130292] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bea8a67-35df-45be-bf57-95c80494d7fe taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.130540] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.130619] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2bea8a67-35df-45be-bf57-95c80494d7fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.131375] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f471eee-9a54-4a5a-af33-2144fa5ff2cd with status ACTIVE [ 670.131553] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.132466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.132466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.132466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.132466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.132466] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.132466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.132466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.132466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.132848] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.132848] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.132848] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.132956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.133565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.134658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.135600] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f471eee-9a54-4a5a-af33-2144fa5ff2cd is going to be updated. [ 670.154101] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.154176] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.154234] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.154445] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.154578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.154732] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f471eee-9a54-4a5a-af33-2144fa5ff2cd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.639420] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2bea8a67-35df-45be-bf57-95c80494d7fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.778436] env[69637]: INFO networking_nsxv3.common.synchronization [None req-3c9d9863-21c2-493e-bfb8-0e9a653cacbb None None] Enqueued Resource ID: 14f0916a-3081-4f41-9e9d-7cbe8679cde9 with Priority: HIGHEST for action port [ 670.778767] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14f0916a-3081-4f41-9e9d-7cbe8679cde9 with Priority: HIGHEST for action port [ 670.779303] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-14f0916a-3081-4f41-9e9d-7cbe8679cde9 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.779414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14f0916a-3081-4f41-9e9d-7cbe8679cde9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.779462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14f0916a-3081-4f41-9e9d-7cbe8679cde9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.780480] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14f0916a-3081-4f41-9e9d-7cbe8679cde9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.780665] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14f0916a-3081-4f41-9e9d-7cbe8679cde9',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.847024] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 in Status: SUCCESS [ 670.847024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.847024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.847024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.847024] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.847024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.847024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.847024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.847024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.847024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.847024] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e7e0a9c-c4a7-4666-a3e3-3138a89446e5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.037328] env[69637]: INFO networking_nsxv3.common.synchronization [req-3d2e6883-c105-4b4f-82de-d544c83b5cb4 req-4760b811-bbf1-4c7b-a8a5-f746fef0ee2e tempest-MigrationsAdminTest-855510084 tempest-MigrationsAdminTest-855510084-project-member] Enqueued Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_members [ 671.037965] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_members [ 671.038338] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.041078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.041078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.041078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.041078] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.041485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.041485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.041485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.041598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.041645] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.141925] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.144538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.144538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.144538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.144538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.144538] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bea8a67-35df-45be-bf57-95c80494d7fe is going to be created. [ 671.183854] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.184295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.184409] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.184673] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.184892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.196510] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bea8a67-35df-45be-bf57-95c80494d7fe in Status: UNINITIALIZED for 2s [ 671.286544] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14f0916a-3081-4f41-9e9d-7cbe8679cde9 [ 671.289451] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.289451] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.289451] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.289451] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.289451] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.289451] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14f0916a-3081-4f41-9e9d-7cbe8679cde9 already deleted. [ 671.289451] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14f0916a-3081-4f41-9e9d-7cbe8679cde9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.335660] env[69637]: INFO networking_nsxv3.common.synchronization [None req-4b3dcffd-814f-46f0-9b08-9ef771262ef5 tempest-ServersV294TestFqdnHostnames-986425398 tempest-ServersV294TestFqdnHostnames-986425398-project-member] Enqueued Resource ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 with Priority: HIGHEST for action security_group_rules [ 671.336210] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 with Priority: HIGHEST for action security_group_rules [ 671.337909] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2bf78cc-b175-4724-9f7a-27b142d3a998 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.337909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.337909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.337909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.337909] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2bf78cc-b175-4724-9f7a-27b142d3a998',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.352538] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.354528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.354528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.354528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.354719] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.354863] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.354955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.355196] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.355331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.355386] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.355593] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.356376] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.356376] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.356376] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.356376] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.356376] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.356637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.356676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.356828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.356877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.357464] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e7e0a9c-c4a7-4666-a3e3-3138a89446e5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.437702] env[69637]: INFO networking_nsxv3.common.synchronization [req-46d8d8fc-7fd2-4cee-beb9-cd97837df064 req-0340dab1-a76e-4d70-99c3-e8681774c395 service nova] Enqueued Resource ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 with Priority: HIGHEST for action security_group_rules [ 671.437812] env[69637]: INFO networking_nsxv3.common.synchronization [req-46d8d8fc-7fd2-4cee-beb9-cd97837df064 req-0340dab1-a76e-4d70-99c3-e8681774c395 service nova] Enqueued Resource ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 with Priority: HIGHEST for action security_group_members [ 671.437891] env[69637]: INFO networking_nsxv3.common.synchronization [req-46d8d8fc-7fd2-4cee-beb9-cd97837df064 req-0340dab1-a76e-4d70-99c3-e8681774c395 service nova] Enqueued Resource ID: 2ed09423-1183-42a3-a1e8-6cd5d637e03b with Priority: HIGHEST for action port [ 671.442037] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 with Priority: HIGHEST for action security_group_rules [ 671.442225] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 with Priority: HIGHEST for action security_group_members [ 671.442426] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed09423-1183-42a3-a1e8-6cd5d637e03b with Priority: HIGHEST for action port [ 671.442843] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2ec22d1-47af-4b01-875c-6ea44a1abaa3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.443488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.443488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.443803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.443899] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2ec22d1-47af-4b01-875c-6ea44a1abaa3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.445261] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.445386] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.445455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.445745] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.445831] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.445923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.445974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.446124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.446441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.446558] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2ec22d1-47af-4b01-875c-6ea44a1abaa3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.450703] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ed09423-1183-42a3-a1e8-6cd5d637e03b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.450937] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ed09423-1183-42a3-a1e8-6cd5d637e03b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.450937] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ed09423-1183-42a3-a1e8-6cd5d637e03b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.451088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ed09423-1183-42a3-a1e8-6cd5d637e03b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.451200] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ed09423-1183-42a3-a1e8-6cd5d637e03b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.544163] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.544446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.544446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.544775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.544923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.545256] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.545342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.545449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.545621] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.545778] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.545831] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 already deleted. [ 671.545914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.704502] env[69637]: INFO networking_nsxv3.common.synchronization [None req-f4ff5c9e-8503-4b6a-94d4-f87cd9a82098 tempest-ServersV294TestFqdnHostnames-986425398 tempest-ServersV294TestFqdnHostnames-986425398-project-member] Enqueued Resource ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 with Priority: HIGHEST for action security_group_rules [ 671.707958] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 with Priority: HIGHEST for action security_group_rules [ 671.708096] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2bf78cc-b175-4724-9f7a-27b142d3a998 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.708292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.795226] env[69637]: INFO networking_nsxv3.common.synchronization [None req-eda1a779-aff7-4af4-ab0d-3c8a0ec730c0 None None] Enqueued Resource ID: 1eb0a4fb-b40a-4368-911d-12166db61d85 with Priority: HIGHEST for action port [ 671.795433] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb0a4fb-b40a-4368-911d-12166db61d85 with Priority: HIGHEST for action port [ 671.795923] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-1eb0a4fb-b40a-4368-911d-12166db61d85 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.796085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1eb0a4fb-b40a-4368-911d-12166db61d85" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.796160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1eb0a4fb-b40a-4368-911d-12166db61d85" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.796429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1eb0a4fb-b40a-4368-911d-12166db61d85" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.796525] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1eb0a4fb-b40a-4368-911d-12166db61d85',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.860761] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.860916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.861013] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.861256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.861348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.861458] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 already deleted. [ 671.861547] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.861771] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5: rpc.has_security_group_logging(os_id): False [ 671.864136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.864645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.864733] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2bf78cc-b175-4724-9f7a-27b142d3a998',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.871451] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.871451] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.871451] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.871451] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.871451] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.871451] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.871451] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.871451] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.871451] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.872126] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.872126] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.872126] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.873294] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.873538] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.873701] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.873877] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.883873] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.884049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.884160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.884401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.884531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.884750] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.884850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.884913] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.885082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.885166] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.885340] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.885569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.885640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.885794] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.885871] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.886817] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.886989] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.887070] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.887927] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.887927] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.887927] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 is going to be created. [ 671.894539] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.894754] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 671.894969] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.896259] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.896591] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-e9ccadc4-073e-4c1d-be91-ecef66de9966 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.897304] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-e9ccadc4-073e-4c1d-be91-ecef66de9966" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.897304] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-e9ccadc4-073e-4c1d-be91-ecef66de9966" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.897304] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-e9ccadc4-073e-4c1d-be91-ecef66de9966" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.897459] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9ccadc4-073e-4c1d-be91-ecef66de9966',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.952670] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.952820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.956059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.956059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.956059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.956059] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.956059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.956059] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2ec22d1-47af-4b01-875c-6ea44a1abaa3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.957607] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ed09423-1183-42a3-a1e8-6cd5d637e03b with status ACTIVE [ 671.958669] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.958669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.958669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.958669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.958669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.958669] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.959267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.959267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.959267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.960048] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.961016] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.961016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.961016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.961146] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.961569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.961569] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ed09423-1183-42a3-a1e8-6cd5d637e03b is going to be updated. [ 671.976238] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 in Status: IN_PROGRESS for 2s [ 671.984627] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.984782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.984849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.985128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.985255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.985412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ed09423-1183-42a3-a1e8-6cd5d637e03b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.191509] env[69637]: INFO networking_nsxv3.common.synchronization [None req-f3e41f01-40f1-469f-b96e-75453d411a3b None None] Enqueued Resource ID: 3da53076-3b9f-4741-b9fc-fdb011cb8ee4 with Priority: HIGHEST for action port [ 672.191845] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3da53076-3b9f-4741-b9fc-fdb011cb8ee4 with Priority: HIGHEST for action port [ 672.192440] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-3da53076-3b9f-4741-b9fc-fdb011cb8ee4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.192568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3da53076-3b9f-4741-b9fc-fdb011cb8ee4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.192637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3da53076-3b9f-4741-b9fc-fdb011cb8ee4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.192900] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3da53076-3b9f-4741-b9fc-fdb011cb8ee4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.192975] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3da53076-3b9f-4741-b9fc-fdb011cb8ee4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.299802] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1eb0a4fb-b40a-4368-911d-12166db61d85 [ 672.299802] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.299802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.299802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.299802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.299802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.299802] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1eb0a4fb-b40a-4368-911d-12166db61d85 already deleted. [ 672.299802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1eb0a4fb-b40a-4368-911d-12166db61d85" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.391244] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.391244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.391789] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.392389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.392389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.392463] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 already deleted. [ 672.392627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.400359] env[69637]: INFO networking_nsxv3.common.synchronization [req-7ee0449c-9e42-428a-87cd-10c25d9c4fd8 req-5dbeff2e-4d04-4fdc-951d-886dce80ca92 tempest-DeleteServersAdminTestJSON-327482863 tempest-DeleteServersAdminTestJSON-327482863-project-admin] Enqueued Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_members [ 672.400974] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_members [ 672.401527] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.401749] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.402615] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.403639] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.403832] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.403996] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port e9ccadc4-073e-4c1d-be91-ecef66de9966 not found, creating... [ 672.404823] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.405010] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.405149] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.405420] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.405568] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.405899] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.406217] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.406363] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.406599] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.406755] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.406936] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: e9ccadc4-073e-4c1d-be91-ecef66de9966 is going to be created. [ 672.408521] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-645e75b0-47c9-44b7-81c7-713e50cf04dc taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.408712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.408935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.409153] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.409655] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.409818] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.410065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.410223] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.410365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.411060] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.441453] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.441453] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.441618] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.441839] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.442083] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.443229] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-e9ccadc4-073e-4c1d-be91-ecef66de9966" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.464317] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2ec22d1-47af-4b01-875c-6ea44a1abaa3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.694717] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3da53076-3b9f-4741-b9fc-fdb011cb8ee4 [ 672.695864] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.695864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.695864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.695864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.695864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.695864] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3da53076-3b9f-4741-b9fc-fdb011cb8ee4 already deleted. [ 672.695864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3da53076-3b9f-4741-b9fc-fdb011cb8ee4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.913868] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.914158] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.914158] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.914910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.914910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.914910] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.914910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.914910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.915292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.915292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.915292] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc is going to be updated. [ 672.945310] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.945458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.945536] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.946035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.946035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.955219] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc in Status: IN_PROGRESS for 2s [ 672.973222] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.973222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.973222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.973222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.973222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.973222] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 is going to be created. [ 672.998436] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.998585] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.998658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.998872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.999042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.009211] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 in Status: UNINITIALIZED for 2s [ 673.215645] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bea8a67-35df-45be-bf57-95c80494d7fe in Status: SUCCESS [ 673.215867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.216061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.216279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.216476] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.216590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.216654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.216808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.216888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.217098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.217098] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2bea8a67-35df-45be-bf57-95c80494d7fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.305187] env[69637]: INFO networking_nsxv3.common.synchronization [req-0435441e-c815-4686-bb10-a6d170736e3b req-84054e21-dc5d-4dc3-b640-301038077e62 tempest-ServerDiskConfigTestJSON-538739594 tempest-ServerDiskConfigTestJSON-538739594-project-member] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 673.308929] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 673.308929] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.308929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.308929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.308929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.308929] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.308929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.308929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.308929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.308929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.308929] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.375754] env[69637]: INFO networking_nsxv3.common.synchronization [None req-88e58bd9-b16b-4eed-b99e-4bf5ffa0e34d tempest-ServerActionsV293TestJSON-116364786 tempest-ServerActionsV293TestJSON-116364786-project-member] Enqueued Resource ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 with Priority: HIGHEST for action security_group_rules [ 673.375754] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 with Priority: HIGHEST for action security_group_rules [ 673.376233] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb173e06-7b41-4fdf-ae0b-3bb378905a07 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.376233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.376233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.380018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.380018] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb173e06-7b41-4fdf-ae0b-3bb378905a07',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.565287] env[69637]: INFO networking_nsxv3.common.synchronization [None req-6ef7f2e4-f5c6-45dd-99f9-60e3acbf08c4 tempest-ServerActionsV293TestJSON-116364786 tempest-ServerActionsV293TestJSON-116364786-project-member] Enqueued Resource ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 with Priority: HIGHEST for action security_group_rules [ 673.566427] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 with Priority: HIGHEST for action security_group_rules [ 673.567083] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb173e06-7b41-4fdf-ae0b-3bb378905a07 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.567247] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.722362] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2bea8a67-35df-45be-bf57-95c80494d7fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.811034] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.811034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.811222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.811309] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.811409] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.811639] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.811744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.811801] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.811990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.812087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.812173] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac already deleted. [ 673.812256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.853845] env[69637]: INFO networking_nsxv3.common.synchronization [req-3d2e6883-c105-4b4f-82de-d544c83b5cb4 req-98b740fc-95d0-49f0-9e37-f48ec96f7339 service nova] Enqueued Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_rules [ 673.853991] env[69637]: INFO networking_nsxv3.common.synchronization [req-3d2e6883-c105-4b4f-82de-d544c83b5cb4 req-98b740fc-95d0-49f0-9e37-f48ec96f7339 service nova] Enqueued Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_members [ 673.854136] env[69637]: INFO networking_nsxv3.common.synchronization [req-3d2e6883-c105-4b4f-82de-d544c83b5cb4 req-98b740fc-95d0-49f0-9e37-f48ec96f7339 service nova] Enqueued Resource ID: e9ccadc4-073e-4c1d-be91-ecef66de9966 with Priority: HIGHEST for action port [ 673.854371] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_rules [ 673.854494] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_members [ 673.854586] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9ccadc4-073e-4c1d-be91-ecef66de9966 with Priority: HIGHEST for action port [ 673.856335] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.856548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.856548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.856841] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.856902] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.857826] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.857947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.858025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.858205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.858356] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.858463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.858534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.858733] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.858827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.858923] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.861450] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9ccadc4-073e-4c1d-be91-ecef66de9966 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.861450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9ccadc4-073e-4c1d-be91-ecef66de9966" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.861450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9ccadc4-073e-4c1d-be91-ecef66de9966" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.861450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9ccadc4-073e-4c1d-be91-ecef66de9966" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.861749] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9ccadc4-073e-4c1d-be91-ecef66de9966',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.896016] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.896016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.896016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.896016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.896016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.896016] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 already deleted. [ 673.896016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.896016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.896374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.897252] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb173e06-7b41-4fdf-ae0b-3bb378905a07',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.993125] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 in Status: SUCCESS [ 673.993125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.009022] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-185 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.009022] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.009526] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.013211] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.013522] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.013694] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.018273] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.018273] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.018273] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.018273] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.018273] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.018273] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.018273] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.018273] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.019543] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.019543] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.036323] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.036510] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 674.036651] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.037214] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.037214] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-84b3b09a-101b-44f3-8972-255b8e2bab3c taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.037389] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-84b3b09a-101b-44f3-8972-255b8e2bab3c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.037476] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-84b3b09a-101b-44f3-8972-255b8e2bab3c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.037838] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-84b3b09a-101b-44f3-8972-255b8e2bab3c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.037983] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84b3b09a-101b-44f3-8972-255b8e2bab3c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.225693] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2bea8a67-35df-45be-bf57-95c80494d7fe: rpc.has_security_group_logging(os_id): False [ 674.246988] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.247081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.247121] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.247308] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.247405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.247639] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.247741] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.247808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.247987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.248048] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.248399] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bea8a67-35df-45be-bf57-95c80494d7fe is going to be created. [ 674.311447] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.311447] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.311447] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.311447] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.311447] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.322424] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bea8a67-35df-45be-bf57-95c80494d7fe in Status: IN_PROGRESS for 2s [ 674.363486] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.364554] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.364693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.365160] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9ccadc4-073e-4c1d-be91-ecef66de9966 with status ACTIVE [ 674.365160] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.365160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.365160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.365546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.365546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.365621] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.365668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.365731] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.365882] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.365957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.366167] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.366244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.366281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.366887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.366887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.366887] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9ccadc4-073e-4c1d-be91-ecef66de9966 is going to be updated. [ 674.389955] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.390111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.390181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.390412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.390620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.390801] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9ccadc4-073e-4c1d-be91-ecef66de9966" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.425876] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.425876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.426090] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.426188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.426241] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.426711] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 already deleted. [ 674.426711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.544646] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.544892] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.545068] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.545393] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.545577] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.545721] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 84b3b09a-101b-44f3-8972-255b8e2bab3c not found, creating... [ 674.546032] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.546216] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.546327] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.546589] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.546694] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.546997] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.547183] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.547298] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.547528] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.547804] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.547919] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 84b3b09a-101b-44f3-8972-255b8e2bab3c is going to be created. [ 674.579835] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.580175] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.580253] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.580565] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.580795] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.581024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-84b3b09a-101b-44f3-8972-255b8e2bab3c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.872000] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.967336] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc in Status: SUCCESS [ 674.967336] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc deletion is rescheduled due to dependency. [ 674.967336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.021441] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 in Status: SUCCESS [ 675.021441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.021441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.021441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.021441] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.021441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.021441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.021441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.021441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.021441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.021441] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2ec22d1-47af-4b01-875c-6ea44a1abaa3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.378976] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.378976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.379194] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.380526] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.380526] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.380708] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 is going to be created. [ 675.407073] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.407073] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.407073] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.407073] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.407073] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.416791] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: UNINITIALIZED for 2s [ 675.528020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.528020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.528020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.528020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.528020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.528020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.528020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.528020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.528020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.528020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.528020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.528020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.528020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.528020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.528020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.528020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.529240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.529240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.529240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.529240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.529240] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2ec22d1-47af-4b01-875c-6ea44a1abaa3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.870901] env[69637]: INFO networking_nsxv3.common.synchronization [None req-1a852f01-eab2-4dff-babc-6a5a07e89057 None None] Enqueued Resource ID: 5f9b08f0-e6bb-44e3-a168-6631f2bc655e with Priority: HIGHEST for action port [ 675.874374] env[69637]: INFO networking_nsxv3.common.synchronization [req-0435441e-c815-4686-bb10-a6d170736e3b req-ce395355-7e00-4129-91b0-cd617b735183 service nova] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_rules [ 675.874374] env[69637]: INFO networking_nsxv3.common.synchronization [req-0435441e-c815-4686-bb10-a6d170736e3b req-ce395355-7e00-4129-91b0-cd617b735183 service nova] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 675.874374] env[69637]: INFO networking_nsxv3.common.synchronization [req-0435441e-c815-4686-bb10-a6d170736e3b req-ce395355-7e00-4129-91b0-cd617b735183 service nova] Enqueued Resource ID: 84b3b09a-101b-44f3-8972-255b8e2bab3c with Priority: HIGHEST for action port [ 675.874598] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f9b08f0-e6bb-44e3-a168-6631f2bc655e with Priority: HIGHEST for action port [ 675.874687] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 675.875720] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_rules [ 675.875720] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84b3b09a-101b-44f3-8972-255b8e2bab3c with Priority: HIGHEST for action port [ 675.875720] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f9b08f0-e6bb-44e3-a168-6631f2bc655e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.875720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f9b08f0-e6bb-44e3-a168-6631f2bc655e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.875720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f9b08f0-e6bb-44e3-a168-6631f2bc655e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.876404] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f9b08f0-e6bb-44e3-a168-6631f2bc655e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.876565] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f9b08f0-e6bb-44e3-a168-6631f2bc655e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.878024] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.878024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.878024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.878024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.878244] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.878244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.878244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.879919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.879919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.879919] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.879919] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.880903] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.880985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.884156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.884156] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.884156] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-84b3b09a-101b-44f3-8972-255b8e2bab3c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.884156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84b3b09a-101b-44f3-8972-255b8e2bab3c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.884156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84b3b09a-101b-44f3-8972-255b8e2bab3c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.884156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84b3b09a-101b-44f3-8972-255b8e2bab3c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.884156] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84b3b09a-101b-44f3-8972-255b8e2bab3c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.033028] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2ec22d1-47af-4b01-875c-6ea44a1abaa3: rpc.has_security_group_logging(os_id): False [ 676.050732] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.050959] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.051618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.051618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.051618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.051618] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.051853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.051946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.052385] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.052548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.052735] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.052945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.052945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.053148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.053252] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.053462] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.053594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.053787] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.053853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.054056] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.054056] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 is going to be created. [ 676.128517] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.128517] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.128517] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.128845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.128845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.153972] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 in Status: IN_PROGRESS for 2s [ 676.337087] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bea8a67-35df-45be-bf57-95c80494d7fe in Status: SUCCESS [ 676.337321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.388033] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.392699] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f9b08f0-e6bb-44e3-a168-6631f2bc655e [ 676.392949] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.393073] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.393255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.395807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.395807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.395807] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f9b08f0-e6bb-44e3-a168-6631f2bc655e already deleted. [ 676.395807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f9b08f0-e6bb-44e3-a168-6631f2bc655e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.395807] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.395807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.415088] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84b3b09a-101b-44f3-8972-255b8e2bab3c with status ACTIVE [ 676.415307] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.415438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.415505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.415717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.415802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.415983] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.416089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.416148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.416349] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.416389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.416540] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.416629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.416687] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.416824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.416928] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.416969] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84b3b09a-101b-44f3-8972-255b8e2bab3c is going to be updated. [ 676.439149] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.439149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.439149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.439325] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.439383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.439585] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84b3b09a-101b-44f3-8972-255b8e2bab3c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.721247] env[69637]: INFO networking_nsxv3.common.synchronization [req-cf503d42-7771-4fb1-9399-cb15265dc8f3 req-5cd8b84a-68db-415c-bcb9-489c0ebdd7bb tempest-ServersAdminNegativeTestJSON-2061472953 tempest-ServersAdminNegativeTestJSON-2061472953-project-member] Enqueued Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_members [ 676.721642] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_members [ 676.721921] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-552e4f46-9b42-4666-9223-428ed3c3368c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.722206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.722206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.722978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.722978] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.722978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.722978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.722978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.723285] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.723285] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.890793] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.226472] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.395774] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.395774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.395774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.395774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.395774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.395774] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be created. [ 677.419076] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.419076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.419076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.419076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.419076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.430041] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: SUCCESS [ 677.430041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.430041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.430041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.430041] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.430041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.430041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.430041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.430041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.430041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.430041] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.431150] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: UNINITIALIZED for 2s [ 677.732571] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.930025] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.930025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.930025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.930025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.930025] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.930025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.930476] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.930865] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.931196] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.931515] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.931782] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.932049] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.935024] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.935024] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.935024] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.935024] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.936505] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.936643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.936706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.936914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.937116] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.937257] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.937322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.937516] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.937613] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.937902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.938082] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.938176] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.938236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.938485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.938566] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.938714] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.938714] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.938839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.938839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.938936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.939018] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.958068] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.958068] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 677.958068] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.958068] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.958736] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-7f73eff5-d128-4fd4-be22-48436f631479 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.958889] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-7f73eff5-d128-4fd4-be22-48436f631479" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.959029] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-7f73eff5-d128-4fd4-be22-48436f631479" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.959364] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-7f73eff5-d128-4fd4-be22-48436f631479" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.959501] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f73eff5-d128-4fd4-be22-48436f631479',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.171620] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 in Status: SUCCESS [ 678.171620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.235231] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.235542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.235909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.235909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.236024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.236601] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 552e4f46-9b42-4666-9223-428ed3c3368c is going to be updated. [ 678.268138] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.270428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.270428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.270664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.270866] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.283833] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 552e4f46-9b42-4666-9223-428ed3c3368c in Status: IN_PROGRESS for 2s [ 678.445334] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bff14a3b-698b-4fee-8b4e-d724ef23de40: rpc.has_security_group_logging(os_id): False [ 678.461677] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.462058] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.462279] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.462662] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.462859] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.463095] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 7f73eff5-d128-4fd4-be22-48436f631479 not found, creating... [ 678.463492] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.463730] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.463907] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.464335] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.464789] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.465386] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.465599] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.465787] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.466144] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.466359] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.466589] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 7f73eff5-d128-4fd4-be22-48436f631479 is going to be created. [ 678.469108] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.469277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.469348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.469522] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.469686] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.469948] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.470062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.471039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.471039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.471039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.471039] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.471039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.471039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.471039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.471384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.471384] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.471384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.471530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.471583] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.471707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.471769] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 is going to be created. [ 678.510460] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.510705] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.510835] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.511130] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.511361] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.511622] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-7f73eff5-d128-4fd4-be22-48436f631479" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.542159] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.542369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.542458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.542723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.542936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.556120] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: IN_PROGRESS for 2s [ 679.002293] env[69637]: INFO networking_nsxv3.common.synchronization [None req-80e7ef05-e4e7-452a-b4a8-15e3714ccacb None None] Enqueued Resource ID: 5c38440e-93d2-4926-9bb8-e641359eb57c with Priority: HIGHEST for action port [ 679.004024] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c38440e-93d2-4926-9bb8-e641359eb57c with Priority: HIGHEST for action port [ 679.004634] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c38440e-93d2-4926-9bb8-e641359eb57c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.004930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c38440e-93d2-4926-9bb8-e641359eb57c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.005107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c38440e-93d2-4926-9bb8-e641359eb57c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.005482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c38440e-93d2-4926-9bb8-e641359eb57c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.005677] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c38440e-93d2-4926-9bb8-e641359eb57c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.029037] env[69637]: INFO networking_nsxv3.common.synchronization [req-c9fb6ddb-87a3-49ec-9fd2-52985a04690a req-d15d5ac3-1268-4b59-a530-8a92c637ee4c tempest-FloatingIPsAssociationTestJSON-1060765468 tempest-FloatingIPsAssociationTestJSON-1060765468-project-member] Enqueued Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_members [ 679.029037] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_members [ 679.029391] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fa4a6e-8adc-47da-9b8e-35f70f60c275 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.029391] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.030620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.030620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.030620] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.030620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.030620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.030892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.030892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.031025] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.223958] env[69637]: INFO networking_nsxv3.common.synchronization [req-cf503d42-7771-4fb1-9399-cb15265dc8f3 req-6135eb3c-c8b2-444b-9e9f-18012305a99f service nova] Enqueued Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_rules [ 679.224113] env[69637]: INFO networking_nsxv3.common.synchronization [req-cf503d42-7771-4fb1-9399-cb15265dc8f3 req-6135eb3c-c8b2-444b-9e9f-18012305a99f service nova] Enqueued Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_members [ 679.224215] env[69637]: INFO networking_nsxv3.common.synchronization [req-cf503d42-7771-4fb1-9399-cb15265dc8f3 req-6135eb3c-c8b2-444b-9e9f-18012305a99f service nova] Enqueued Resource ID: 7f73eff5-d128-4fd4-be22-48436f631479 with Priority: HIGHEST for action port [ 679.224446] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_rules [ 679.224573] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_members [ 679.224671] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f73eff5-d128-4fd4-be22-48436f631479 with Priority: HIGHEST for action port [ 679.225270] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-552e4f46-9b42-4666-9223-428ed3c3368c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.225399] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.225460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.225665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.225836] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.229890] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-552e4f46-9b42-4666-9223-428ed3c3368c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.229968] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.230165] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f73eff5-d128-4fd4-be22-48436f631479 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.230303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f73eff5-d128-4fd4-be22-48436f631479" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.230343] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f73eff5-d128-4fd4-be22-48436f631479" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.230566] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f73eff5-d128-4fd4-be22-48436f631479" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.230623] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f73eff5-d128-4fd4-be22-48436f631479',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.441238] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 679.441529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.441681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.441906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.442138] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.442490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.442490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.442490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.442706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.442706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.442706] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.509347] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c38440e-93d2-4926-9bb8-e641359eb57c [ 679.510100] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.510100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.510100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.510100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.510305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.510601] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c38440e-93d2-4926-9bb8-e641359eb57c already deleted. [ 679.510601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c38440e-93d2-4926-9bb8-e641359eb57c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.534603] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.534603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.534603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.534603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.534603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.534603] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.535056] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.535056] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.535056] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.535056] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.535218] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 already deleted. [ 679.535218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.735507] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-552e4f46-9b42-4666-9223-428ed3c3368c taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.735507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.735507] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f73eff5-d128-4fd4-be22-48436f631479 with status ACTIVE [ 679.735507] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.735507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.735507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.736481] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.736481] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.736481] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.736481] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.736481] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.736481] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.736828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.736890] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.737283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.737343] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.737822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.737822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.738694] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f73eff5-d128-4fd4-be22-48436f631479 is going to be updated. [ 679.760827] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.760827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.760827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.760827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.760827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.760827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f73eff5-d128-4fd4-be22-48436f631479" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.848039] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-80 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.848143] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-80" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.848279] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-80" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.848630] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-80" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.848882] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.853098] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.853305] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.853576] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.853725] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.853935] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.854073] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.854710] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.854710] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.854906] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.854906] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.854986] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.886107] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.886248] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 679.886407] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.886705] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-80" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.887066] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-5878e8d8-4c3c-44c4-abb4-da5d96b5798f taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.887252] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-5878e8d8-4c3c-44c4-abb4-da5d96b5798f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.887366] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-5878e8d8-4c3c-44c4-abb4-da5d96b5798f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.887682] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-5878e8d8-4c3c-44c4-abb4-da5d96b5798f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.887808] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5878e8d8-4c3c-44c4-abb4-da5d96b5798f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.945561] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.945749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.946643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.947378] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.947378] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.947378] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.947378] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.947668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.947668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.947668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.947803] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.947902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.947985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.948314] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.948480] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.950111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.950111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.950111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.950111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.950111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.950111] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.294579] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 552e4f46-9b42-4666-9223-428ed3c3368c in Status: SUCCESS [ 680.294789] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.295084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.295415] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.295663] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.295888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.295992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.296238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.296406] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.296558] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.389964] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.394019] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.394019] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.394019] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.394019] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.394019] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 5878e8d8-4c3c-44c4-abb4-da5d96b5798f not found, creating... [ 680.394019] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.394019] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.394019] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.394019] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.394019] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.395179] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.395179] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.395179] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.395179] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.395179] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.395179] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 5878e8d8-4c3c-44c4-abb4-da5d96b5798f is going to be created. [ 680.412811] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.413170] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.413346] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.413629] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.413885] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.414178] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-5878e8d8-4c3c-44c4-abb4-da5d96b5798f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.451755] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bac27816-ae12-436b-86da-6c4bbde7b2ac: rpc.has_security_group_logging(os_id): False [ 680.470984] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.471226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.471292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.471536] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.471621] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.471877] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.472124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.472124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.472224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.472299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.472490] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.472578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.472726] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.472881] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.472951] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.473309] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.473579] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.473649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.473899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.474092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.474188] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be created. [ 680.547470] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.547470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.547470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.547470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.547674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.560656] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 680.573836] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: SUCCESS [ 680.573836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.799451] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.186464] env[69637]: INFO networking_nsxv3.common.synchronization [req-168887bc-92ec-40fd-93ef-7e0704806237 req-5e805fa7-988f-4a01-93a3-55aa82dae00e tempest-ServersTestMultiNic-1929872957 tempest-ServersTestMultiNic-1929872957-project-member] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 681.186464] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 681.186464] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.186464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.186464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.186464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.186833] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.186833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.186833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.186962] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.187065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.187168] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.293105] env[69637]: INFO networking_nsxv3.common.synchronization [None req-e2449b87-5fab-4edf-b074-91da29fdbf71 None None] Enqueued Resource ID: 832cd9ef-43ec-48ab-afac-3dbecb08feaa with Priority: HIGHEST for action port [ 681.293654] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832cd9ef-43ec-48ab-afac-3dbecb08feaa with Priority: HIGHEST for action port [ 681.293953] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-832cd9ef-43ec-48ab-afac-3dbecb08feaa taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.294319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-832cd9ef-43ec-48ab-afac-3dbecb08feaa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.294319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-832cd9ef-43ec-48ab-afac-3dbecb08feaa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.295867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-832cd9ef-43ec-48ab-afac-3dbecb08feaa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.295961] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('832cd9ef-43ec-48ab-afac-3dbecb08feaa',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.306078] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.345926] env[69637]: INFO networking_nsxv3.common.synchronization [req-c9fb6ddb-87a3-49ec-9fd2-52985a04690a req-fd4007f9-d8f2-49d6-9ce9-0484db051c8f service nova] Enqueued Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_rules [ 681.346242] env[69637]: INFO networking_nsxv3.common.synchronization [req-c9fb6ddb-87a3-49ec-9fd2-52985a04690a req-fd4007f9-d8f2-49d6-9ce9-0484db051c8f service nova] Enqueued Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_members [ 681.346499] env[69637]: INFO networking_nsxv3.common.synchronization [req-c9fb6ddb-87a3-49ec-9fd2-52985a04690a req-fd4007f9-d8f2-49d6-9ce9-0484db051c8f service nova] Enqueued Resource ID: 5878e8d8-4c3c-44c4-abb4-da5d96b5798f with Priority: HIGHEST for action port [ 681.350992] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_rules [ 681.353416] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_members [ 681.353416] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5878e8d8-4c3c-44c4-abb4-da5d96b5798f with Priority: HIGHEST for action port [ 681.353416] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73fa4a6e-8adc-47da-9b8e-35f70f60c275 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.353416] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.353416] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.353416] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.353416] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.353416] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fa4a6e-8adc-47da-9b8e-35f70f60c275 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.353416] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.353416] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.355106] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.359110] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.359110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.359110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.359110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.359110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.359110] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.359110] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5878e8d8-4c3c-44c4-abb4-da5d96b5798f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.359110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5878e8d8-4c3c-44c4-abb4-da5d96b5798f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.359110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5878e8d8-4c3c-44c4-abb4-da5d96b5798f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.359110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5878e8d8-4c3c-44c4-abb4-da5d96b5798f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.359110] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5878e8d8-4c3c-44c4-abb4-da5d96b5798f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.523746] env[69637]: INFO networking_nsxv3.common.synchronization [req-168887bc-92ec-40fd-93ef-7e0704806237 req-cfe7cb14-c0bf-44d8-9b80-9b3206b817e8 tempest-ServersTestMultiNic-1929872957 tempest-ServersTestMultiNic-1929872957-project-member] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 681.524372] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 681.524739] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.524865] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.690075] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.690287] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.690370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.690691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.690866] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.691102] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.691210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.691273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.691440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.691518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.691605] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae already deleted. [ 681.691688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.691903] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.692081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.692245] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.692352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.692387] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.692514] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.692605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.692701] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.800177] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 832cd9ef-43ec-48ab-afac-3dbecb08feaa [ 681.800430] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.800543] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.800654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.800876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.800966] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.801084] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:832cd9ef-43ec-48ab-afac-3dbecb08feaa already deleted. [ 681.801167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-832cd9ef-43ec-48ab-afac-3dbecb08feaa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.807753] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.807921] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.808030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.808254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.808254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.808354] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 552e4f46-9b42-4666-9223-428ed3c3368c is going to be updated. [ 681.834972] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.835542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.835542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.835542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.835925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.844460] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 552e4f46-9b42-4666-9223-428ed3c3368c in Status: IN_PROGRESS for 2s [ 681.859085] env[69637]: INFO networking_nsxv3.common.synchronization [req-168887bc-92ec-40fd-93ef-7e0704806237 req-dcbf5c03-204f-44a0-a608-9279a52d4d32 tempest-ServersTestMultiNic-1929872957 tempest-ServersTestMultiNic-1929872957-project-member] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 681.859490] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fa4a6e-8adc-47da-9b8e-35f70f60c275 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.859594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.859754] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.861307] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5878e8d8-4c3c-44c4-abb4-da5d96b5798f with status ACTIVE [ 681.862243] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.862372] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.862444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.865677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.865677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.865677] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.865677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.865677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.865677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.865677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.865677] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.865677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.865677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.865677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.865677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.865677] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5878e8d8-4c3c-44c4-abb4-da5d96b5798f is going to be updated. [ 681.866441] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 681.866585] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.866655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.884229] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.884384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.884536] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.884729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.884879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.885090] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5878e8d8-4c3c-44c4-abb4-da5d96b5798f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.181032] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.181142] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-573" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.181229] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-573" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.182147] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-573" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.182147] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.182147] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.182392] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.182924] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.182924] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.182924] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.183184] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.183672] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.183672] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.183672] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.183829] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.184067] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.200301] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.200301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.200301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.200301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.200301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.200301] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.200301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.200301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.200301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.200301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.200301] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae already deleted. [ 682.200301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.200301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.201107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.201107] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.201107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.201107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.201107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.201107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.201107] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.203864] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.204059] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 682.204531] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.204531] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-573" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.204748] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-8477ff2e-6d35-48c7-98c6-f56a503d67e2 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.204910] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-8477ff2e-6d35-48c7-98c6-f56a503d67e2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.204910] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-8477ff2e-6d35-48c7-98c6-f56a503d67e2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.205221] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-8477ff2e-6d35-48c7-98c6-f56a503d67e2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.205359] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8477ff2e-6d35-48c7-98c6-f56a503d67e2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.364387] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.582119] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 682.582480] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.703615] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.703774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.703831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.704363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.704363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.704363] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.704363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.704669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.704669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.704745] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.704781] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae already deleted. [ 682.705539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.706983] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.706983] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.707158] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.707940] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.707940] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.707940] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 8477ff2e-6d35-48c7-98c6-f56a503d67e2 not found, creating... [ 682.707940] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.708266] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.708266] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.708338] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.708755] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.708833] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.709586] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.709586] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.709586] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.709586] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.709586] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 8477ff2e-6d35-48c7-98c6-f56a503d67e2 is going to be created. [ 682.730161] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.730161] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.730161] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.730161] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.730161] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.730161] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-8477ff2e-6d35-48c7-98c6-f56a503d67e2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.867757] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.868438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.868541] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.868872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.869028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.869256] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 is going to be created. [ 682.893565] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.893565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.893565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.893806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.893905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.903124] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 in Status: UNINITIALIZED for 2s [ 683.854889] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 552e4f46-9b42-4666-9223-428ed3c3368c in Status: SUCCESS [ 683.855164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.855281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.855492] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.855715] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.855860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.855940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.856193] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.856239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.856319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.859148] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.868208] env[69637]: INFO networking_nsxv3.common.synchronization [req-168887bc-92ec-40fd-93ef-7e0704806237 req-679991d1-efd3-4a0a-ac32-a004c5b804a3 service nova] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_rules [ 683.868373] env[69637]: INFO networking_nsxv3.common.synchronization [req-168887bc-92ec-40fd-93ef-7e0704806237 req-679991d1-efd3-4a0a-ac32-a004c5b804a3 service nova] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 683.868540] env[69637]: INFO networking_nsxv3.common.synchronization [req-168887bc-92ec-40fd-93ef-7e0704806237 req-679991d1-efd3-4a0a-ac32-a004c5b804a3 service nova] Enqueued Resource ID: 8477ff2e-6d35-48c7-98c6-f56a503d67e2 with Priority: HIGHEST for action port [ 683.868885] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_rules [ 683.868928] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 683.869073] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8477ff2e-6d35-48c7-98c6-f56a503d67e2 with Priority: HIGHEST for action port [ 683.869696] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.869861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.869861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.871881] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.871881] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.873384] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.873511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.873586] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.876206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.876206] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.876206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.876206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.876206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.876206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.876206] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.876206] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-8477ff2e-6d35-48c7-98c6-f56a503d67e2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.876206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8477ff2e-6d35-48c7-98c6-f56a503d67e2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.876733] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8477ff2e-6d35-48c7-98c6-f56a503d67e2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.876733] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8477ff2e-6d35-48c7-98c6-f56a503d67e2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.876733] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8477ff2e-6d35-48c7-98c6-f56a503d67e2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.361776] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-552e4f46-9b42-4666-9223-428ed3c3368c taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.361968] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.362060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.364266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.364266] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.364266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.364266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.364266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.364266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.364266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.364266] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-552e4f46-9b42-4666-9223-428ed3c3368c taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.364266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.364266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.364266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.364266] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.364266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.364266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.364266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.364266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.364266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.364266] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.374637] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.374821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.381188] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8477ff2e-6d35-48c7-98c6-f56a503d67e2 with status ACTIVE [ 684.381396] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.381563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.381655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.381903] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.381991] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.382203] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.382306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.382366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.382517] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.382602] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.382776] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.382860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.382920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.383069] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.383141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.383220] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8477ff2e-6d35-48c7-98c6-f56a503d67e2 is going to be updated. [ 684.384596] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.409043] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.409043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.409043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.409043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.409043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.409043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8477ff2e-6d35-48c7-98c6-f56a503d67e2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.872892] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 552e4f46-9b42-4666-9223-428ed3c3368c: rpc.has_security_group_logging(os_id): False [ 684.886082] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.900279] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.900637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.900856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.901032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.901127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.901366] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.901477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.901518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.901676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.901751] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.901925] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.902123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.902123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.902233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.902322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.902534] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.902629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.902692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.902918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.902918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.903016] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 552e4f46-9b42-4666-9223-428ed3c3368c is going to be updated. [ 684.919439] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 in Status: SUCCESS [ 684.919661] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.920208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.920435] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.920750] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.920824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.920932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.921273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.921273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.921273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.921553] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.964822] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.964822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.964822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.964822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.964822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.975837] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 552e4f46-9b42-4666-9223-428ed3c3368c in Status: IN_PROGRESS for 2s [ 685.002472] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-675 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.002682] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-675" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.002819] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-675" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.003402] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-675" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.003624] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.003823] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.004015] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.004825] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.004825] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.004825] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.004825] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.004825] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.005104] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.005104] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.005175] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.005371] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.026094] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.026536] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 685.026536] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.026674] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-675" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.028188] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-feea4540-c9de-4fca-817b-d2ad1d5fc6e1 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.028587] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-feea4540-c9de-4fca-817b-d2ad1d5fc6e1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.029065] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-feea4540-c9de-4fca-817b-d2ad1d5fc6e1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.029582] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-feea4540-c9de-4fca-817b-d2ad1d5fc6e1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.029699] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feea4540-c9de-4fca-817b-d2ad1d5fc6e1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.389917] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.390114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.390209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.391105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.391212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.392513] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be created. [ 685.415200] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.415200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.415200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.415200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.415200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.424426] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: UNINITIALIZED for 2s [ 685.424876] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fa4a6e-8adc-47da-9b8e-35f70f60c275 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.425129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.425198] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.428229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.428229] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.428229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.428229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.428229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.428229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.428229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.428229] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fa4a6e-8adc-47da-9b8e-35f70f60c275 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.428229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.428229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.428229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.428229] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.428229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.428229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.428934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.429620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.430674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.430938] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.537573] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.537828] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.537973] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.538380] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.538556] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.538738] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port feea4540-c9de-4fca-817b-d2ad1d5fc6e1 not found, creating... [ 685.539166] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.539376] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.539554] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.539987] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.540162] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.540459] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.540745] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.540936] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.541202] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.541846] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.541846] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: feea4540-c9de-4fca-817b-d2ad1d5fc6e1 is going to be created. [ 685.561699] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.562621] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.562621] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.562621] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.562864] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.563024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-feea4540-c9de-4fca-817b-d2ad1d5fc6e1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.934222] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73fa4a6e-8adc-47da-9b8e-35f70f60c275: rpc.has_security_group_logging(os_id): False [ 685.954908] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.954908] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.954908] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.955330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.955330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.955540] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.957035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.957035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.957035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.957035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.957035] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.959456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.959456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.961190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.961354] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.961650] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.961772] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.961838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.962137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.962137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.962277] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 is going to be created. [ 686.019232] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.019232] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.019232] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.019232] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.019232] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.031067] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 in Status: IN_PROGRESS for 2s [ 686.665556] env[69637]: INFO networking_nsxv3.common.synchronization [req-fd926ede-8c50-4f07-a563-5061581fcbea req-6522975d-62a6-4ef8-b040-1699237bf442 tempest-ServerExternalEventsTest-1178473512 tempest-ServerExternalEventsTest-1178473512-project-member] Enqueued Resource ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 with Priority: HIGHEST for action security_group_members [ 686.666529] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 with Priority: HIGHEST for action security_group_members [ 686.667040] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.667151] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.667245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.667528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.667767] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.667951] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.668111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.668340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.668482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.668644] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2ec22d1-47af-4b01-875c-6ea44a1abaa3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.989552] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 552e4f46-9b42-4666-9223-428ed3c3368c in Status: SUCCESS [ 686.989868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.993075] env[69637]: INFO networking_nsxv3.common.synchronization [req-168887bc-92ec-40fd-93ef-7e0704806237 req-9b5899f7-4fa3-48c7-90a1-309f930bb6dc service nova] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_rules [ 686.993316] env[69637]: INFO networking_nsxv3.common.synchronization [req-168887bc-92ec-40fd-93ef-7e0704806237 req-9b5899f7-4fa3-48c7-90a1-309f930bb6dc service nova] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 686.993513] env[69637]: INFO networking_nsxv3.common.synchronization [req-168887bc-92ec-40fd-93ef-7e0704806237 req-9b5899f7-4fa3-48c7-90a1-309f930bb6dc service nova] Enqueued Resource ID: feea4540-c9de-4fca-817b-d2ad1d5fc6e1 with Priority: HIGHEST for action port [ 686.994114] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_rules [ 686.994281] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 686.994418] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feea4540-c9de-4fca-817b-d2ad1d5fc6e1 with Priority: HIGHEST for action port [ 686.994708] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.994817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.996078] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.996304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.997015] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-feea4540-c9de-4fca-817b-d2ad1d5fc6e1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.997555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-feea4540-c9de-4fca-817b-d2ad1d5fc6e1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.997910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-feea4540-c9de-4fca-817b-d2ad1d5fc6e1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.998233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-feea4540-c9de-4fca-817b-d2ad1d5fc6e1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.998401] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feea4540-c9de-4fca-817b-d2ad1d5fc6e1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.176027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.176027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.176027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.178101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.178101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.178101] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.178101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.178101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.178101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.178101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.178101] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 is going to be updated. [ 687.205584] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.207391] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.207550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.208665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.208665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.221877] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 in Status: IN_PROGRESS for 2s [ 687.434768] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 687.435049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.435319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.435508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.435811] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.435952] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.435952] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.436204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.436204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.436472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.436472] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.437692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.437692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.437892] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.438024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.438107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.438310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.438435] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.438714] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.500956] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port feea4540-c9de-4fca-817b-d2ad1d5fc6e1 with status ACTIVE [ 687.501213] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.501366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.501704] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.501704] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.501871] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.502053] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.502198] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.502277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.502472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.502620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.503450] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.503450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.503450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.504766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.505825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.505825] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: feea4540-c9de-4fca-817b-d2ad1d5fc6e1 is going to be updated. [ 687.524570] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.524570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.524792] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.524833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.525040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.525128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-feea4540-c9de-4fca-817b-d2ad1d5fc6e1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.604555] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.604777] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-573" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.605051] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-573" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.605152] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-573" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.605445] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.605602] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.605742] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.605991] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.606464] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.606734] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.606899] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.607058] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.607242] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.607421] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.607580] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.607756] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.613895] env[69637]: INFO networking_nsxv3.common.synchronization [req-99c2de8f-d4c8-4b04-8604-3dd35b84486c req-364e54c7-3d90-476d-a5f9-7d4d9b05ca4f tempest-ListServerFiltersTestJSON-297691074 tempest-ListServerFiltersTestJSON-297691074-project-member] Enqueued Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 687.614472] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 687.615240] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.615240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.615240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.615629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.615907] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.615907] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.616405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.616405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.616405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.616405] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.639454] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.639454] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 687.639454] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.639454] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-573" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.639454] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-0b3bc7b6-ec1a-4591-951b-703df6ee0afc taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.639799] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-0b3bc7b6-ec1a-4591-951b-703df6ee0afc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.639799] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-0b3bc7b6-ec1a-4591-951b-703df6ee0afc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.640654] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-0b3bc7b6-ec1a-4591-951b-703df6ee0afc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.640974] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b3bc7b6-ec1a-4591-951b-703df6ee0afc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.944214] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.945391] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.945497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.043817] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 in Status: SUCCESS [ 688.044119] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.119522] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.119654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.119771] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.119970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.120333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.120333] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.120440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.120440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.120829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.120829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.120829] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 already deleted. [ 688.120986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.147020] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.147020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.147020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.147020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.147020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.147020] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 0b3bc7b6-ec1a-4591-951b-703df6ee0afc not found, creating... [ 688.147020] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.147020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.147020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.147020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.147020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.147597] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.147597] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.147935] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.148325] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.148669] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.149047] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 0b3bc7b6-ec1a-4591-951b-703df6ee0afc is going to be created. [ 688.171271] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.171271] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.171271] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.171271] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.171816] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.171816] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-0b3bc7b6-ec1a-4591-951b-703df6ee0afc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.257883] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-990 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.257883] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-990" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.257883] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-990" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.259247] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-990" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.259635] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.260242] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.260242] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.260242] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.262151] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.262151] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.262151] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.262151] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.262151] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.262151] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.262871] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.262871] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.281315] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.281468] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 688.281619] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.281841] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-990" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.282195] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-d1c384cc-c6f8-49ad-b853-02cb81975bc1 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.282815] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-d1c384cc-c6f8-49ad-b853-02cb81975bc1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.282815] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-d1c384cc-c6f8-49ad-b853-02cb81975bc1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.283063] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-d1c384cc-c6f8-49ad-b853-02cb81975bc1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.283063] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1c384cc-c6f8-49ad-b853-02cb81975bc1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.446913] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.789709] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.789954] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.790098] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.790385] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.790536] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.790736] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port d1c384cc-c6f8-49ad-b853-02cb81975bc1 not found, creating... [ 688.791026] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.791205] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.794188] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.794500] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.794655] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.795127] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.795370] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.795497] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.795738] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.795884] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.796043] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: d1c384cc-c6f8-49ad-b853-02cb81975bc1 is going to be created. [ 688.819300] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.819504] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.819643] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.820497] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.820497] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.820497] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-d1c384cc-c6f8-49ad-b853-02cb81975bc1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.916387] env[69637]: INFO networking_nsxv3.common.synchronization [req-168887bc-92ec-40fd-93ef-7e0704806237 req-61553230-7f31-428e-9468-1fe957d39a7a service nova] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_rules [ 688.916699] env[69637]: INFO networking_nsxv3.common.synchronization [req-168887bc-92ec-40fd-93ef-7e0704806237 req-61553230-7f31-428e-9468-1fe957d39a7a service nova] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 688.917174] env[69637]: INFO networking_nsxv3.common.synchronization [req-168887bc-92ec-40fd-93ef-7e0704806237 req-61553230-7f31-428e-9468-1fe957d39a7a service nova] Enqueued Resource ID: 0b3bc7b6-ec1a-4591-951b-703df6ee0afc with Priority: HIGHEST for action port [ 688.917780] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_rules [ 688.918148] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 688.918148] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3bc7b6-ec1a-4591-951b-703df6ee0afc with Priority: HIGHEST for action port [ 688.918323] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.918450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.918695] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.918802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.918981] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b3bc7b6-ec1a-4591-951b-703df6ee0afc taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.919120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b3bc7b6-ec1a-4591-951b-703df6ee0afc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.919188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b3bc7b6-ec1a-4591-951b-703df6ee0afc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.919474] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b3bc7b6-ec1a-4591-951b-703df6ee0afc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.919600] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b3bc7b6-ec1a-4591-951b-703df6ee0afc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.949629] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.949859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.950032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.950384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.950384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.950534] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be updated. [ 688.996754] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.996976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.996976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.997201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.997348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.006211] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 689.233670] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 in Status: SUCCESS [ 689.234117] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 deletion is rescheduled due to dependency. [ 689.234117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.422578] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b3bc7b6-ec1a-4591-951b-703df6ee0afc with status ACTIVE [ 689.422804] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.422955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.423038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.423265] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.423359] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.423535] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.423646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.423713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.423863] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.425912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.425912] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.425912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.425912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.425912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.425912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.425912] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b3bc7b6-ec1a-4591-951b-703df6ee0afc is going to be updated. [ 689.446045] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.446045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.446045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.446045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.446045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.446045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b3bc7b6-ec1a-4591-951b-703df6ee0afc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.516681] env[69637]: INFO networking_nsxv3.common.synchronization [req-99c2de8f-d4c8-4b04-8604-3dd35b84486c req-6e1c3386-7374-42dd-ac27-b244a7bba9b2 service nova] Enqueued Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_rules [ 689.516681] env[69637]: INFO networking_nsxv3.common.synchronization [req-99c2de8f-d4c8-4b04-8604-3dd35b84486c req-6e1c3386-7374-42dd-ac27-b244a7bba9b2 service nova] Enqueued Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 689.516681] env[69637]: INFO networking_nsxv3.common.synchronization [req-99c2de8f-d4c8-4b04-8604-3dd35b84486c req-6e1c3386-7374-42dd-ac27-b244a7bba9b2 service nova] Enqueued Resource ID: d1c384cc-c6f8-49ad-b853-02cb81975bc1 with Priority: HIGHEST for action port [ 689.517780] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_rules [ 689.518026] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 689.518228] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1c384cc-c6f8-49ad-b853-02cb81975bc1 with Priority: HIGHEST for action port [ 689.518793] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.519035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.519185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.519981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.520285] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.521911] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.522263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.522405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.522721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.522980] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.523179] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.523309] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.523570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.523723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.523890] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.525443] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1c384cc-c6f8-49ad-b853-02cb81975bc1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.525996] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1c384cc-c6f8-49ad-b853-02cb81975bc1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.526194] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1c384cc-c6f8-49ad-b853-02cb81975bc1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.526682] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1c384cc-c6f8-49ad-b853-02cb81975bc1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.526839] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1c384cc-c6f8-49ad-b853-02cb81975bc1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.022954] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.023118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.026499] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.029295] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1c384cc-c6f8-49ad-b853-02cb81975bc1 with status ACTIVE [ 690.029580] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.029733] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.029783] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.030063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.030166] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.030380] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.030456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.030504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.030880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.030880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.031031] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.031031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.031152] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.031202] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.031471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.031471] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1c384cc-c6f8-49ad-b853-02cb81975bc1 is going to be updated. [ 690.050149] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.050149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.050149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.050149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.050149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.050789] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1c384cc-c6f8-49ad-b853-02cb81975bc1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.235267] env[69637]: INFO networking_nsxv3.common.synchronization [req-11c739d0-35db-438a-9aab-9fa9e978c060 req-dff204a9-0327-41e0-ac07-3bed4d82a66a tempest-ListServersNegativeTestJSON-710888184 tempest-ListServersNegativeTestJSON-710888184-project-member] Enqueued Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 690.235876] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 690.238306] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.238459] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.238654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.239155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.239155] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.239289] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.239289] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.239415] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.239547] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.239605] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.529049] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.542437] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.542661] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.542870] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.543146] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.543392] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.543550] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.543667] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.543882] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.544029] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.544245] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.544347] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.544497] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.544579] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.544658] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.544768] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.544906] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.562935] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.563127] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 690.563267] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.563440] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.563803] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-6f6f84c7-a8d1-423b-b060-b711b932b23a taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.563985] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-6f6f84c7-a8d1-423b-b060-b711b932b23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.564119] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-6f6f84c7-a8d1-423b-b060-b711b932b23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.564421] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-6f6f84c7-a8d1-423b-b060-b711b932b23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.564564] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f6f84c7-a8d1-423b-b060-b711b932b23a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.743760] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.743932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.744038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.744228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.744323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.744514] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.744612] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.744692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.744935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.745074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.745127] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63016cee-78e5-471f-804a-ad9bcf1b801a already deleted. [ 690.745205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.016699] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 691.016987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.017186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.017412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.017610] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.017727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.017803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.017945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.018038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.018127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.018302] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.018387] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.018438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.018585] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.018801] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.018900] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.018973] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.019206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.019289] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.019370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.019458] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.020388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.020517] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.021635] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.021635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.021635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.021635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.021635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.021635] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.033031] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.033204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.033266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.033460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.033640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.033640] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 is going to be created. [ 691.060691] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.060984] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.060984] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.061325] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.062064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.067202] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.067202] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.067202] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.067202] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.067482] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.067530] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 6f6f84c7-a8d1-423b-b060-b711b932b23a not found, creating... [ 691.068893] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.068893] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.068893] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.068893] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.068893] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.068893] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.068893] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.069422] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.069422] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.069422] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.069422] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 6f6f84c7-a8d1-423b-b060-b711b932b23a is going to be created. [ 691.071502] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: UNINITIALIZED for 2s [ 691.097562] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.097756] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.097941] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.098321] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.098732] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.099212] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-6f6f84c7-a8d1-423b-b060-b711b932b23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.523406] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ce64dc8-7267-4039-bf03-bb3eb50298ae: rpc.has_security_group_logging(os_id): False [ 691.527176] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.540019] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.540244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.540244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.540458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.540538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.540836] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.540969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.541035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.541152] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.541231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.541403] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.541497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.541559] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.541710] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.541774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.543847] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.543847] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.543847] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.543847] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.543847] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.543847] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be created. [ 691.599138] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.599348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.599421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.599614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.599800] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.623475] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 691.802462] env[69637]: INFO networking_nsxv3.common.synchronization [req-11c739d0-35db-438a-9aab-9fa9e978c060 req-732de5f8-ea24-45aa-a2f8-b80e702ddec6 service nova] Enqueued Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_rules [ 691.802650] env[69637]: INFO networking_nsxv3.common.synchronization [req-11c739d0-35db-438a-9aab-9fa9e978c060 req-732de5f8-ea24-45aa-a2f8-b80e702ddec6 service nova] Enqueued Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 691.802753] env[69637]: INFO networking_nsxv3.common.synchronization [req-11c739d0-35db-438a-9aab-9fa9e978c060 req-732de5f8-ea24-45aa-a2f8-b80e702ddec6 service nova] Enqueued Resource ID: 6f6f84c7-a8d1-423b-b060-b711b932b23a with Priority: HIGHEST for action port [ 691.803644] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_rules [ 691.803812] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 691.804410] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6f84c7-a8d1-423b-b060-b711b932b23a with Priority: HIGHEST for action port [ 691.804410] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.804410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.804410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.804761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.804849] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.806344] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.806344] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.806344] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.806344] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.806344] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.806344] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.806344] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.806745] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.806928] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.806928] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.807720] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f6f84c7-a8d1-423b-b060-b711b932b23a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.807823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f6f84c7-a8d1-423b-b060-b711b932b23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.807904] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f6f84c7-a8d1-423b-b060-b711b932b23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.808067] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f6f84c7-a8d1-423b-b060-b711b932b23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.808301] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f6f84c7-a8d1-423b-b060-b711b932b23a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.029626] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.309738] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.309900] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.310144] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.311119] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6f6f84c7-a8d1-423b-b060-b711b932b23a with status ACTIVE [ 692.311313] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.311469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.311649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.311925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.312046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.312238] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.312371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.312458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.312647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.312726] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.312959] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.313075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.313137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.313279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.313364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.313429] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6f6f84c7-a8d1-423b-b060-b711b932b23a is going to be updated. [ 692.350395] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.350615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.350721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.351023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.352331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.352331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f6f84c7-a8d1-423b-b060-b711b932b23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.537617] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.537617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.537617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.537617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.537617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.537617] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be updated. [ 692.569129] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.569421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.569547] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.570059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.570318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.582526] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 692.816510] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.966448] env[69637]: INFO networking_nsxv3.common.synchronization [req-11c739d0-35db-438a-9aab-9fa9e978c060 req-ca56a4ed-036f-46c9-8b85-9cd1603ebde6 tempest-ListServersNegativeTestJSON-710888184 tempest-ListServersNegativeTestJSON-710888184-project-member] Enqueued Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 692.967489] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 692.967747] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.967850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.084052] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: SUCCESS [ 693.084052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.084052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.084052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.084052] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.084052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.084052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.084052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.084052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.084052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.084052] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.322884] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.323101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.323159] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.323372] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.323465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.323565] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63016cee-78e5-471f-804a-ad9bcf1b801a is going to be created. [ 693.351294] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.351511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.351511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.352374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.352374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.361361] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: UNINITIALIZED for 2s [ 693.439642] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.439826] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.439864] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.440261] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.441566] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.442549] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.442549] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.442549] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.442549] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.443146] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.443146] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.443146] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.443146] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.443367] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.443367] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.443434] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.464043] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.464043] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 693.464313] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.464353] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.464677] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-45bc2ab2-9a2c-4d88-a458-b8de88a11c2c taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.465248] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-45bc2ab2-9a2c-4d88-a458-b8de88a11c2c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.465701] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-45bc2ab2-9a2c-4d88-a458-b8de88a11c2c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.469024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-45bc2ab2-9a2c-4d88-a458-b8de88a11c2c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.469024] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45bc2ab2-9a2c-4d88-a458-b8de88a11c2c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.587655] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.588021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.588021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.589423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.589687] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.589826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.589878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.590038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.590124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.590233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.591064] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.591273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.591342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.591506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.591664] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.591780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.591842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.592245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.592498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.592645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.592761] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.634715] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 693.637764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.637764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.637764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.637764] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.970388] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.970780] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.970859] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.971464] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.971639] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.971804] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 45bc2ab2-9a2c-4d88-a458-b8de88a11c2c not found, creating... [ 693.972104] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.972310] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.972661] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.973271] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.973271] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.974644] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.974901] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.975068] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.975360] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.975511] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.975662] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 45bc2ab2-9a2c-4d88-a458-b8de88a11c2c is going to be created. [ 694.000331] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.000331] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.000331] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.002639] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.002927] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.003285] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-45bc2ab2-9a2c-4d88-a458-b8de88a11c2c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.098381] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c162e9c6-1558-4a4a-82d6-88bff0e93b92: rpc.has_security_group_logging(os_id): False [ 694.131030] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.131030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.131030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.131030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.131030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.131030] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.131030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.131030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.131030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.131030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.132270] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.132734] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.133623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.134147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.134850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.134850] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.135043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.135515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.135515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.135721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.135897] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 is going to be created. [ 694.140542] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.141178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.231615] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.231866] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.231866] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.232070] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.232267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.243561] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: IN_PROGRESS for 2s [ 694.595035] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 694.597173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.597173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.597173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.597173] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.597173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.597173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.597173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.597173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.597173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.598455] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.747212] env[69637]: INFO networking_nsxv3.common.synchronization [req-11c739d0-35db-438a-9aab-9fa9e978c060 req-b53055e0-4bf3-4eb1-8b16-fc3bdeded259 service nova] Enqueued Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_rules [ 694.747602] env[69637]: INFO networking_nsxv3.common.synchronization [req-11c739d0-35db-438a-9aab-9fa9e978c060 req-b53055e0-4bf3-4eb1-8b16-fc3bdeded259 service nova] Enqueued Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 694.747602] env[69637]: INFO networking_nsxv3.common.synchronization [req-11c739d0-35db-438a-9aab-9fa9e978c060 req-b53055e0-4bf3-4eb1-8b16-fc3bdeded259 service nova] Enqueued Resource ID: 45bc2ab2-9a2c-4d88-a458-b8de88a11c2c with Priority: HIGHEST for action port [ 694.748399] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_rules [ 694.748689] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 694.748802] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45bc2ab2-9a2c-4d88-a458-b8de88a11c2c with Priority: HIGHEST for action port [ 694.750709] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.754038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.754372] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.754494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.754669] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-45bc2ab2-9a2c-4d88-a458-b8de88a11c2c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.754776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45bc2ab2-9a2c-4d88-a458-b8de88a11c2c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.754871] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45bc2ab2-9a2c-4d88-a458-b8de88a11c2c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.755165] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45bc2ab2-9a2c-4d88-a458-b8de88a11c2c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.755261] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45bc2ab2-9a2c-4d88-a458-b8de88a11c2c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.102551] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.102684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.102767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.103038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.103275] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.103436] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.103552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.103782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.103927] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.104099] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.104314] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.104469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.104584] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.104838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.105078] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.105237] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.105407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.105561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.105757] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.105848] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.105975] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.258403] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45bc2ab2-9a2c-4d88-a458-b8de88a11c2c with status ACTIVE [ 695.258642] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.258785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.258849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.259085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.259180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.259359] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.259459] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.259524] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.259678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.259760] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.259943] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.260051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.260113] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.260255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.260329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.260412] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45bc2ab2-9a2c-4d88-a458-b8de88a11c2c is going to be updated. [ 695.280479] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.280479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.280479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.280479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.280777] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.280864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45bc2ab2-9a2c-4d88-a458-b8de88a11c2c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.380496] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: SUCCESS [ 695.380496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.380496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.380496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.380496] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.380496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.380496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.380496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.380496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.380496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.380496] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.380496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.380496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.380496] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.380496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.380496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.380496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.380496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.380496] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.609258] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ce64dc8-7267-4039-bf03-bb3eb50298ae: rpc.has_security_group_logging(os_id): False [ 695.627943] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.628122] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.628307] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.628423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.628518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.628753] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.628855] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.628917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.629084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.629160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.629649] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.629649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.629649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.629649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.629811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.629877] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.629944] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.629973] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.630118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.630194] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.630279] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be updated. [ 695.687276] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.687542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.687542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.687782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.687939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.702603] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 695.779140] env[69637]: INFO networking_nsxv3.common.synchronization [req-11c739d0-35db-438a-9aab-9fa9e978c060 req-1e75cc21-6da8-4b27-a132-3ad2f87605bc tempest-ListServersNegativeTestJSON-710888184 tempest-ListServersNegativeTestJSON-710888184-project-member] Enqueued Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 695.779667] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 695.779981] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.780097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.883478] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.884652] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.884828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.257852] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: SUCCESS [ 696.259693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.387797] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.481215] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.482058] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.482259] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.482547] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.483093] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.483093] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.483234] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.483349] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.483496] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.483707] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.483826] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.483957] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.484126] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.484295] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.484953] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.484953] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.503262] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.506030] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 696.506030] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.506030] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.506030] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-5ecf52d3-8613-406f-a330-71109daed57d taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.506030] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-5ecf52d3-8613-406f-a330-71109daed57d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.506030] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-5ecf52d3-8613-406f-a330-71109daed57d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.506030] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-5ecf52d3-8613-406f-a330-71109daed57d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.506030] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ecf52d3-8613-406f-a330-71109daed57d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.892906] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.893575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.893575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.893575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.893575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.893575] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63016cee-78e5-471f-804a-ad9bcf1b801a is going to be updated. [ 696.921749] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.922104] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.922191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.922548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.922803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.933890] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: IN_PROGRESS for 2s [ 697.008688] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.008890] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.009097] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.009903] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.009903] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.009903] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 5ecf52d3-8613-406f-a330-71109daed57d not found, creating... [ 697.010143] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.010249] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.010748] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.011047] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.014205] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.014205] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.014205] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.014205] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.014205] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.014205] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.014205] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 5ecf52d3-8613-406f-a330-71109daed57d is going to be created. [ 697.035028] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.035028] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.035028] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.035028] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.035028] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.035028] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-5ecf52d3-8613-406f-a330-71109daed57d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.722357] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 697.722609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.722825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.723095] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.723187] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.071021] env[69637]: INFO networking_nsxv3.common.synchronization [req-11c739d0-35db-438a-9aab-9fa9e978c060 req-14a919fa-e63a-459f-90c0-5062588829af service nova] Enqueued Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_rules [ 698.071021] env[69637]: INFO networking_nsxv3.common.synchronization [req-11c739d0-35db-438a-9aab-9fa9e978c060 req-14a919fa-e63a-459f-90c0-5062588829af service nova] Enqueued Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 698.071021] env[69637]: INFO networking_nsxv3.common.synchronization [req-11c739d0-35db-438a-9aab-9fa9e978c060 req-14a919fa-e63a-459f-90c0-5062588829af service nova] Enqueued Resource ID: 5ecf52d3-8613-406f-a330-71109daed57d with Priority: HIGHEST for action port [ 698.071021] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_rules [ 698.071021] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 698.071021] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ecf52d3-8613-406f-a330-71109daed57d with Priority: HIGHEST for action port [ 698.072117] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.072388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.072701] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.072921] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.073219] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ecf52d3-8613-406f-a330-71109daed57d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.074136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ecf52d3-8613-406f-a330-71109daed57d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.074510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ecf52d3-8613-406f-a330-71109daed57d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.074831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ecf52d3-8613-406f-a330-71109daed57d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.075208] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ecf52d3-8613-406f-a330-71109daed57d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.229576] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.229576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.229576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.229775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.230039] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.230039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.230039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.230182] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.230263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.230317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.230406] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.581859] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ecf52d3-8613-406f-a330-71109daed57d with status ACTIVE [ 698.581859] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.581859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.581859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.582192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.582192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.582824] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.582824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.582824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.582824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.582824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.583290] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.583290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.583290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.583444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.583444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.583514] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ecf52d3-8613-406f-a330-71109daed57d is going to be updated. [ 698.605262] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.605262] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.605430] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.605860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.605860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.606106] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ecf52d3-8613-406f-a330-71109daed57d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.708623] env[69637]: INFO networking_nsxv3.common.synchronization [req-f318354a-a852-4827-9e5a-09a8995a2660 req-7dbb7f59-adb3-4d5c-be72-e3b5299f20ab tempest-VolumesAssistedSnapshotsTest-1383698631 tempest-VolumesAssistedSnapshotsTest-1383698631-project-member] Enqueued Resource ID: 67b79615-8ab9-4c90-bd99-6702f487431a with Priority: HIGHEST for action security_group_members [ 698.708623] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b79615-8ab9-4c90-bd99-6702f487431a with Priority: HIGHEST for action security_group_members [ 698.708623] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-67b79615-8ab9-4c90-bd99-6702f487431a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.708623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.708623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.708858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.709013] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.709113] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.709175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.709326] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.709409] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.709503] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67b79615-8ab9-4c90-bd99-6702f487431a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.736169] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.736323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.736390] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.736603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.736763] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.736862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.736924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.737088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.737202] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.737258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.737409] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.737497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.737554] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.737693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.737832] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.737916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.737971] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.738161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.739910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.739910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.739910] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.943671] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: SUCCESS [ 698.943947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.944145] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.944352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.944544] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.944665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.944718] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.944980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.944980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.945151] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.112055] env[69637]: INFO networking_nsxv3.common.synchronization [None req-6f42aacc-31b9-46eb-8e4a-8e4d64319925 None None] Enqueued Resource ID: 062204c1-1999-4d14-b6ab-08c62f1bbf1d with Priority: HIGHEST for action port [ 699.112055] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062204c1-1999-4d14-b6ab-08c62f1bbf1d with Priority: HIGHEST for action port [ 699.112645] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-062204c1-1999-4d14-b6ab-08c62f1bbf1d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.112645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-062204c1-1999-4d14-b6ab-08c62f1bbf1d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.112645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-062204c1-1999-4d14-b6ab-08c62f1bbf1d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.112738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-062204c1-1999-4d14-b6ab-08c62f1bbf1d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.112768] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('062204c1-1999-4d14-b6ab-08c62f1bbf1d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.169985] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.170273] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-766" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.170418] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-766" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.170802] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-766" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.172819] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.173501] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.173501] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.173501] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.173604] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.173788] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.173901] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.174109] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.174156] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.174234] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.174342] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.174477] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.193276] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.193533] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 699.193771] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.194098] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-766" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.194542] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-2ee23092-8a5d-480d-879e-bd2268e66c63 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.197022] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-2ee23092-8a5d-480d-879e-bd2268e66c63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.197022] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-2ee23092-8a5d-480d-879e-bd2268e66c63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.197022] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-2ee23092-8a5d-480d-879e-bd2268e66c63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.197022] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ee23092-8a5d-480d-879e-bd2268e66c63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.216426] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.216585] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.216644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.217041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.217391] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.217537] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.217618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.217689] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.217917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.218059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.218183] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67b79615-8ab9-4c90-bd99-6702f487431a already deleted. [ 699.218318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.240873] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ce64dc8-7267-4039-bf03-bb3eb50298ae: rpc.has_security_group_logging(os_id): False [ 699.262513] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.262715] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.262807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.263031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.265294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.265294] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.265294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.265294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.265294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.265294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.265294] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.265294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.265294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.265294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.265294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.265294] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.265294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.265294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.265832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.265832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.265832] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be updated. [ 699.282968] env[69637]: INFO networking_nsxv3.common.synchronization [req-1eb0afc5-fdeb-4639-82d3-25149f82fef2 req-3bb28ae6-c11d-40b4-a263-1b57ebb93b2a tempest-ImagesTestJSON-1924392618 tempest-ImagesTestJSON-1924392618-project-member] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 699.283153] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 699.283438] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.283577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.283781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.283893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.284053] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.286126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.286126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.286126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.286126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.286126] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.335966] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.336142] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.336215] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.336422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.336576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.352805] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 699.449927] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.614576] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 062204c1-1999-4d14-b6ab-08c62f1bbf1d [ 699.614906] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.615142] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.615217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.615492] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.615577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.615674] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:062204c1-1999-4d14-b6ab-08c62f1bbf1d already deleted. [ 699.615759] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-062204c1-1999-4d14-b6ab-08c62f1bbf1d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.700721] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.700979] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.701210] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.701544] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.701608] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.701755] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 2ee23092-8a5d-480d-879e-bd2268e66c63 not found, creating... [ 699.702071] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.702218] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.704365] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.706188] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.706375] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.706730] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.706872] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.707019] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.707302] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.707465] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.707617] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 2ee23092-8a5d-480d-879e-bd2268e66c63 is going to be created. [ 699.729380] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.729602] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.729728] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.730020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.730309] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.730475] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-2ee23092-8a5d-480d-879e-bd2268e66c63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.786389] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.786911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.787228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.787631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.787874] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.788286] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.788583] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.788760] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.789066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.789274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.789508] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 699.818222] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.818411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.818479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.818707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.818849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.835223] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 699.952040] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.457078] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.457078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.457078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.457078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.457078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.457078] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63016cee-78e5-471f-804a-ad9bcf1b801a is going to be updated. [ 700.486727] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.487301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.487503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.487864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.489175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.502373] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: IN_PROGRESS for 2s [ 700.669429] env[69637]: INFO networking_nsxv3.common.synchronization [req-f318354a-a852-4827-9e5a-09a8995a2660 req-bfd30b06-34d5-4f7d-9c10-9bc9b9606153 service nova] Enqueued Resource ID: 67b79615-8ab9-4c90-bd99-6702f487431a with Priority: HIGHEST for action security_group_rules [ 700.670449] env[69637]: INFO networking_nsxv3.common.synchronization [req-f318354a-a852-4827-9e5a-09a8995a2660 req-bfd30b06-34d5-4f7d-9c10-9bc9b9606153 service nova] Enqueued Resource ID: 67b79615-8ab9-4c90-bd99-6702f487431a with Priority: HIGHEST for action security_group_members [ 700.670449] env[69637]: INFO networking_nsxv3.common.synchronization [req-f318354a-a852-4827-9e5a-09a8995a2660 req-bfd30b06-34d5-4f7d-9c10-9bc9b9606153 service nova] Enqueued Resource ID: 2ee23092-8a5d-480d-879e-bd2268e66c63 with Priority: HIGHEST for action port [ 700.670449] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b79615-8ab9-4c90-bd99-6702f487431a with Priority: HIGHEST for action security_group_rules [ 700.670449] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b79615-8ab9-4c90-bd99-6702f487431a with Priority: HIGHEST for action security_group_members [ 700.670449] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ee23092-8a5d-480d-879e-bd2268e66c63 with Priority: HIGHEST for action port [ 700.670719] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67b79615-8ab9-4c90-bd99-6702f487431a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.670922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.671032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.671235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.671345] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67b79615-8ab9-4c90-bd99-6702f487431a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.673069] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-67b79615-8ab9-4c90-bd99-6702f487431a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.673069] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.673069] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.673069] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.673069] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.673069] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.673281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.673281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.673335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.673400] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67b79615-8ab9-4c90-bd99-6702f487431a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.674510] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ee23092-8a5d-480d-879e-bd2268e66c63 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.674626] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ee23092-8a5d-480d-879e-bd2268e66c63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.674676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ee23092-8a5d-480d-879e-bd2268e66c63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.675032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ee23092-8a5d-480d-879e-bd2268e66c63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.675109] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ee23092-8a5d-480d-879e-bd2268e66c63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.982568] env[69637]: INFO networking_nsxv3.common.synchronization [req-9dcbea47-ce3c-4537-a0c1-579b8fc2125f req-41f06a14-8903-486b-bcb0-7a2144b55b29 tempest-ServersTestManualDisk-188734878 tempest-ServersTestManualDisk-188734878-project-member] Enqueued Resource ID: 71aadb5f-78e6-44ce-b947-3707467a678d with Priority: HIGHEST for action security_group_members [ 700.982568] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aadb5f-78e6-44ce-b947-3707467a678d with Priority: HIGHEST for action security_group_members [ 700.984408] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aadb5f-78e6-44ce-b947-3707467a678d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.984765] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.984922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.985658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.985897] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.986190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.986342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.987015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.987015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.987128] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71aadb5f-78e6-44ce-b947-3707467a678d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.179436] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67b79615-8ab9-4c90-bd99-6702f487431a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.179436] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-67b79615-8ab9-4c90-bd99-6702f487431a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.179436] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.179753] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ee23092-8a5d-480d-879e-bd2268e66c63 with status ACTIVE [ 701.179791] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.179892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.179963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.180202] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.180287] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.180450] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.180542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.180598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.180756] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.180841] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.181027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.181111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.181169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.181306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.181376] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.181452] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ee23092-8a5d-480d-879e-bd2268e66c63 is going to be updated. [ 701.207238] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.207238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.207238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.207238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.207238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.207238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ee23092-8a5d-480d-879e-bd2268e66c63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.365180] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 701.365515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.411241] env[69637]: INFO networking_nsxv3.common.synchronization [None req-c62687e0-f672-465c-932d-099e66170a60 None None] Enqueued Resource ID: 195ab205-8009-4cd2-9408-9b0a092c185b with Priority: HIGHEST for action port [ 701.411490] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 195ab205-8009-4cd2-9408-9b0a092c185b with Priority: HIGHEST for action port [ 701.411856] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-195ab205-8009-4cd2-9408-9b0a092c185b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.412018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-195ab205-8009-4cd2-9408-9b0a092c185b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.412318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-195ab205-8009-4cd2-9408-9b0a092c185b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.412594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-195ab205-8009-4cd2-9408-9b0a092c185b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.412682] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('195ab205-8009-4cd2-9408-9b0a092c185b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.492944] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.493289] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.493289] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.494688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.495409] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.495896] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.496149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.496149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.500658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.500658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.500658] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aadb5f-78e6-44ce-b947-3707467a678d already deleted. [ 701.500658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.547995] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-444 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.548577] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-444" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.548577] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-444" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.548880] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-444" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.549409] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.549627] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.549760] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.549998] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.550220] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.550483] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.550636] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.550938] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.551012] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.551166] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.551337] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.551570] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.573022] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.573022] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 701.573022] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.573022] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-444" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.573022] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-7519928b-ae27-48a2-99a1-41b36c228023 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.573022] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-7519928b-ae27-48a2-99a1-41b36c228023" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.573022] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-7519928b-ae27-48a2-99a1-41b36c228023" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.573022] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-7519928b-ae27-48a2-99a1-41b36c228023" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.573022] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7519928b-ae27-48a2-99a1-41b36c228023',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.680043] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67b79615-8ab9-4c90-bd99-6702f487431a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.846456] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 701.849476] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 deletion is rescheduled due to dependency. [ 701.849476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.914492] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 195ab205-8009-4cd2-9408-9b0a092c185b [ 701.914732] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.914870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.914943] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.915219] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.915316] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.915418] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:195ab205-8009-4cd2-9408-9b0a092c185b already deleted. [ 701.915500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-195ab205-8009-4cd2-9408-9b0a092c185b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.075978] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.076240] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.076369] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.076648] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.076799] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.076952] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 7519928b-ae27-48a2-99a1-41b36c228023 not found, creating... [ 702.077231] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.077387] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.077503] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.077731] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.077872] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.078183] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.078348] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.078463] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.078687] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.078896] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.079233] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 7519928b-ae27-48a2-99a1-41b36c228023 is going to be created. [ 702.098581] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.098855] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.098966] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.100246] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.100246] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.100246] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-7519928b-ae27-48a2-99a1-41b36c228023" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.182484] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.182683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.182808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.182970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.183080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.183175] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67b79615-8ab9-4c90-bd99-6702f487431a is going to be created. [ 702.211085] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.211323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.211406] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.211815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.211815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.222632] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67b79615-8ab9-4c90-bd99-6702f487431a in Status: UNINITIALIZED for 2s [ 702.516306] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: SUCCESS [ 702.518314] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.518772] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.518833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.519766] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.519766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.519766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.519766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.519766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.519766] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.027506] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.323967] env[69637]: INFO networking_nsxv3.common.synchronization [req-9dcbea47-ce3c-4537-a0c1-579b8fc2125f req-7ec0a2aa-78cb-4e98-bfee-d2c7e39a45e3 service nova] Enqueued Resource ID: 71aadb5f-78e6-44ce-b947-3707467a678d with Priority: HIGHEST for action security_group_rules [ 703.324165] env[69637]: INFO networking_nsxv3.common.synchronization [req-9dcbea47-ce3c-4537-a0c1-579b8fc2125f req-7ec0a2aa-78cb-4e98-bfee-d2c7e39a45e3 service nova] Enqueued Resource ID: 71aadb5f-78e6-44ce-b947-3707467a678d with Priority: HIGHEST for action security_group_members [ 703.324409] env[69637]: INFO networking_nsxv3.common.synchronization [req-9dcbea47-ce3c-4537-a0c1-579b8fc2125f req-7ec0a2aa-78cb-4e98-bfee-d2c7e39a45e3 service nova] Enqueued Resource ID: 7519928b-ae27-48a2-99a1-41b36c228023 with Priority: HIGHEST for action port [ 703.324528] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aadb5f-78e6-44ce-b947-3707467a678d with Priority: HIGHEST for action security_group_rules [ 703.324654] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aadb5f-78e6-44ce-b947-3707467a678d with Priority: HIGHEST for action security_group_members [ 703.324750] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7519928b-ae27-48a2-99a1-41b36c228023 with Priority: HIGHEST for action port [ 703.325307] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71aadb5f-78e6-44ce-b947-3707467a678d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.325430] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.325498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.325698] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.325821] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71aadb5f-78e6-44ce-b947-3707467a678d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.328272] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aadb5f-78e6-44ce-b947-3707467a678d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.328363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.328433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.328621] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.328773] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.328884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.328941] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.329084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.329173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.329261] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71aadb5f-78e6-44ce-b947-3707467a678d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.330042] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-7519928b-ae27-48a2-99a1-41b36c228023 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.330156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7519928b-ae27-48a2-99a1-41b36c228023" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.330227] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7519928b-ae27-48a2-99a1-41b36c228023" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.330382] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7519928b-ae27-48a2-99a1-41b36c228023" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.330457] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7519928b-ae27-48a2-99a1-41b36c228023',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.532375] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.681594] env[69637]: INFO networking_nsxv3.common.synchronization [req-b75ff6d3-93a8-458c-b85b-c0066d479ad8 req-26b8979c-1ce2-4fc6-acf5-3ee5c10c045a tempest-ServersTestJSON-289349315 tempest-ServersTestJSON-289349315-project-member] Enqueued Resource ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb with Priority: HIGHEST for action security_group_members [ 703.681594] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb with Priority: HIGHEST for action security_group_members [ 703.681594] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d9cb429-99aa-4837-be4a-8fc93149f9fb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.681594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.681850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.681850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.682476] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.682476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.682476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.682476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.682476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.683190] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d9cb429-99aa-4837-be4a-8fc93149f9fb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.833678] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aadb5f-78e6-44ce-b947-3707467a678d taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.833895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.834353] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71aadb5f-78e6-44ce-b947-3707467a678d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.835410] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7519928b-ae27-48a2-99a1-41b36c228023 with status ACTIVE [ 703.835410] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.835410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.835410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.835647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.835683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.835879] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.835975] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.836046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.836199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.836279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.836463] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.836557] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.836618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.836762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.836843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.836929] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7519928b-ae27-48a2-99a1-41b36c228023 is going to be updated. [ 703.860428] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.860428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.860428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.860428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.860631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.860769] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7519928b-ae27-48a2-99a1-41b36c228023" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.904533] env[69637]: INFO networking_nsxv3.common.synchronization [req-e19ad26d-82e6-482f-8b19-56ff6ed1bf1c req-f02b6d77-d2d9-4b7f-9540-2f82a038468e tempest-ListServerFiltersTestJSON-297691074 tempest-ListServerFiltersTestJSON-297691074-project-member] Enqueued Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 703.904533] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 703.904533] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.904533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.904533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.904533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.904533] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.904533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.904533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.904533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.904533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.905218] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.035546] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.035718] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.035748] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.036664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.036664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.036664] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63016cee-78e5-471f-804a-ad9bcf1b801a is going to be updated. [ 704.061499] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.061697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.061804] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.061940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.062185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.071535] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: IN_PROGRESS for 2s [ 704.190271] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.190271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.190271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.190271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.190271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.190271] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.190271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.190271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.190271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.190271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.190271] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb is going to be updated. [ 704.221313] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.221505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.221505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.221712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.221952] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.235211] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67b79615-8ab9-4c90-bd99-6702f487431a in Status: SUCCESS [ 704.235453] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.236159] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb in Status: IN_PROGRESS for 2s [ 704.236285] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.236510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.236692] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.236810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.236881] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.237073] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.237150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.237235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.237321] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67b79615-8ab9-4c90-bd99-6702f487431a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.340494] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71aadb5f-78e6-44ce-b947-3707467a678d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.407513] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.478140] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-990 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.479401] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-990" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.479401] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-990" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.479517] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-990" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.480074] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.480074] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.481071] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.481071] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.481071] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.486804] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.486804] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.486804] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.486804] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.486804] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.486804] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.486804] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.504491] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.504690] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 704.504864] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.505146] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-990" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.505527] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-a70c1958-e6b2-4ff7-b8a3-894cfe23632f taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.505741] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-a70c1958-e6b2-4ff7-b8a3-894cfe23632f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.506135] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-a70c1958-e6b2-4ff7-b8a3-894cfe23632f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.506675] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-a70c1958-e6b2-4ff7-b8a3-894cfe23632f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.507189] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a70c1958-e6b2-4ff7-b8a3-894cfe23632f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.740543] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67b79615-8ab9-4c90-bd99-6702f487431a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.843634] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.844292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.844292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.844292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.844292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.844292] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aadb5f-78e6-44ce-b947-3707467a678d is going to be created. [ 704.868264] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.868408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.868584] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.868727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.868923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.879786] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aadb5f-78e6-44ce-b947-3707467a678d in Status: UNINITIALIZED for 2s [ 704.909929] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.994641] env[69637]: INFO networking_nsxv3.common.synchronization [req-3b3cb2a9-0166-44f0-8d1e-7a3e58c4e995 req-32f37141-054b-4246-a58f-7b756a3b8b43 tempest-ServersTestMultiNic-1929872957 tempest-ServersTestMultiNic-1929872957-project-member] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 704.995216] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 704.995524] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.995823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.995899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.996120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.996489] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.996489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.996489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.996626] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.996653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.996732] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.009194] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.012025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.012025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.012025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.012025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.012025] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port a70c1958-e6b2-4ff7-b8a3-894cfe23632f not found, creating... [ 705.012025] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.012025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.012025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.012025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.012025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.014915] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.014915] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.014915] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.015170] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.015370] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.015604] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: a70c1958-e6b2-4ff7-b8a3-894cfe23632f is going to be created. [ 705.038073] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.038314] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.038438] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.038700] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.038928] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.039176] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-a70c1958-e6b2-4ff7-b8a3-894cfe23632f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.183059] env[69637]: INFO networking_nsxv3.common.synchronization [req-3b3cb2a9-0166-44f0-8d1e-7a3e58c4e995 req-5da3862f-dde4-426a-9009-8475bb1522d2 tempest-ServersTestMultiNic-1929872957 tempest-ServersTestMultiNic-1929872957-project-member] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 705.183757] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 705.183854] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.183929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.247349] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67b79615-8ab9-4c90-bd99-6702f487431a: rpc.has_security_group_logging(os_id): False [ 705.268827] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.268969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.269052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.269276] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.269353] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.269627] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.269729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.269795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.269950] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.270030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.270111] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67b79615-8ab9-4c90-bd99-6702f487431a is going to be created. [ 705.345847] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.345847] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.345847] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.346206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.346468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.358321] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67b79615-8ab9-4c90-bd99-6702f487431a in Status: IN_PROGRESS for 2s [ 705.413478] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.413686] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.413763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.414081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.414244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.414355] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 is going to be updated. [ 705.419607] env[69637]: INFO networking_nsxv3.common.synchronization [req-3b3cb2a9-0166-44f0-8d1e-7a3e58c4e995 req-25d630a6-5fcb-4cec-ad71-07ed77d8d5e3 tempest-ServersTestMultiNic-1929872957 tempest-ServersTestMultiNic-1929872957-project-member] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 705.420415] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 705.420977] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.421111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.460883] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.461056] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.461189] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.461765] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.461765] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.471992] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: IN_PROGRESS for 2s [ 705.499482] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.002118] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.080438] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: SUCCESS [ 706.080663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.080853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.081090] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.081277] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.081395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.081460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.081612] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.081685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.081790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.081952] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.082050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.082113] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.082255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.082390] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.082482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.082544] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.082679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.082754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.082834] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.082919] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.083993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.083993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.084188] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.084316] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.084400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.084567] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.084681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.084789] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.121023] env[69637]: INFO networking_nsxv3.common.synchronization [req-e19ad26d-82e6-482f-8b19-56ff6ed1bf1c req-dbc4d5a3-c50b-4a46-925b-0d69273b969b service nova] Enqueued Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_rules [ 706.121210] env[69637]: INFO networking_nsxv3.common.synchronization [req-e19ad26d-82e6-482f-8b19-56ff6ed1bf1c req-dbc4d5a3-c50b-4a46-925b-0d69273b969b service nova] Enqueued Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 706.121347] env[69637]: INFO networking_nsxv3.common.synchronization [req-e19ad26d-82e6-482f-8b19-56ff6ed1bf1c req-dbc4d5a3-c50b-4a46-925b-0d69273b969b service nova] Enqueued Resource ID: a70c1958-e6b2-4ff7-b8a3-894cfe23632f with Priority: HIGHEST for action port [ 706.121564] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_rules [ 706.121703] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 706.121804] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70c1958-e6b2-4ff7-b8a3-894cfe23632f with Priority: HIGHEST for action port [ 706.122315] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.122435] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.122502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.122926] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.122926] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.124373] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.124511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.124753] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-a70c1958-e6b2-4ff7-b8a3-894cfe23632f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.124884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a70c1958-e6b2-4ff7-b8a3-894cfe23632f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.125008] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a70c1958-e6b2-4ff7-b8a3-894cfe23632f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.125189] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a70c1958-e6b2-4ff7-b8a3-894cfe23632f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.125289] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a70c1958-e6b2-4ff7-b8a3-894cfe23632f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.253295] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb in Status: SUCCESS [ 706.253496] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d9cb429-99aa-4837-be4a-8fc93149f9fb deletion is rescheduled due to dependency. [ 706.253607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d9cb429-99aa-4837-be4a-8fc93149f9fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.504181] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.504356] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.504428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.504642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.504748] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.504852] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be updated. [ 706.533028] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.533028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.533028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.533028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.533028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.539753] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 706.589056] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63016cee-78e5-471f-804a-ad9bcf1b801a: rpc.has_security_group_logging(os_id): False [ 706.589056] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.607669] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.607669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.607669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.607669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.607669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.607669] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.607669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.607669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.607669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.607669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.607669] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.607669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.607669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.607669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.607669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.608369] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.608369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.608369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.608369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.608369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.608369] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63016cee-78e5-471f-804a-ad9bcf1b801a is going to be created. [ 706.626764] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.626934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.631087] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a70c1958-e6b2-4ff7-b8a3-894cfe23632f with status ACTIVE [ 706.631087] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.631087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.631087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.631087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.631087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.631383] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.631383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.631383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.631518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.631625] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.631777] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.631876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.631978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.632127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.632201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.632288] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a70c1958-e6b2-4ff7-b8a3-894cfe23632f is going to be updated. [ 706.651225] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.651400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.651465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.651651] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.651791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.652049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a70c1958-e6b2-4ff7-b8a3-894cfe23632f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.662070] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.662210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.662282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.662467] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.662638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.672215] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: IN_PROGRESS for 2s [ 706.890048] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aadb5f-78e6-44ce-b947-3707467a678d in Status: SUCCESS [ 706.890278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.890471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.890869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.891118] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.891261] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.891336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.891528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.891630] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.891718] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.891828] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71aadb5f-78e6-44ce-b947-3707467a678d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.090029] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.368615] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67b79615-8ab9-4c90-bd99-6702f487431a in Status: SUCCESS [ 707.369309] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.393738] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71aadb5f-78e6-44ce-b947-3707467a678d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.483079] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: SUCCESS [ 707.483388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.483666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.483993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.484240] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.484584] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.484584] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.484683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.484747] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.484845] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.592642] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.594895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.594895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.594895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.594895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.594895] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63016cee-78e5-471f-804a-ad9bcf1b801a is going to be updated. [ 707.621568] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.621568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.621568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.621568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.621568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.628492] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: IN_PROGRESS for 2s [ 707.898543] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71aadb5f-78e6-44ce-b947-3707467a678d: rpc.has_security_group_logging(os_id): False [ 707.918046] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.918207] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.918310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.918747] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.918747] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.919044] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.919230] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.919337] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.919596] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.919723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.919844] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71aadb5f-78e6-44ce-b947-3707467a678d is going to be created. [ 707.976487] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.976670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.976762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.976958] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.977154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.986459] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71aadb5f-78e6-44ce-b947-3707467a678d in Status: IN_PROGRESS for 2s [ 707.993043] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.495444] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.551499] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 708.551719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.551924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.552190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.552377] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.552496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.552589] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.552713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.552796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.552894] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.683483] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: SUCCESS [ 708.683742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.683872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.684125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.684215] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.000275] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.000476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.000558] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.000773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.000893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.000996] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 is going to be updated. [ 709.030772] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.030972] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.031059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.031259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.031399] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.040317] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: IN_PROGRESS for 2s [ 709.057862] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.058074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.058141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.058320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.058597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.058706] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.058826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.058879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.059060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.059138] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.059238] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be updated. [ 709.082811] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.082811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.082811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.082811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.082811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.090038] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 709.186683] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.186833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.638789] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: SUCCESS [ 709.639124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.639308] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.639542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.639739] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.642727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.642727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.642727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.642727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.642727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.642727] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.999174] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71aadb5f-78e6-44ce-b947-3707467a678d in Status: SUCCESS [ 709.999640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.143102] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.143321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.143405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.143654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.143857] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.143965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.144064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.144272] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.144370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.144472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.144647] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.144749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.144810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.144988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.145151] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.145287] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.145352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.145518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.145605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.145687] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.145776] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.649887] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63016cee-78e5-471f-804a-ad9bcf1b801a: rpc.has_security_group_logging(os_id): False [ 710.667378] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.667378] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.667378] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.667628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.667706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.667938] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.668354] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.668354] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.668354] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.668354] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.668498] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.668582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.668643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.668804] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.668937] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.669236] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.669236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.669236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.669370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.669413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.669493] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63016cee-78e5-471f-804a-ad9bcf1b801a is going to be updated. [ 710.736102] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.736286] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.737082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.737375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.737535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.752423] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: IN_PROGRESS for 2s [ 710.885443] env[69637]: INFO networking_nsxv3.common.synchronization [None req-f2512f1a-2c70-4fed-83b2-f7bfdd1392b9 None None] Enqueued Resource ID: 8212860b-a637-49cb-8962-1873e76bfe0a with Priority: HIGHEST for action port [ 710.886257] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8212860b-a637-49cb-8962-1873e76bfe0a with Priority: HIGHEST for action port [ 710.886725] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-8212860b-a637-49cb-8962-1873e76bfe0a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.886940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8212860b-a637-49cb-8962-1873e76bfe0a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.887061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8212860b-a637-49cb-8962-1873e76bfe0a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.887474] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8212860b-a637-49cb-8962-1873e76bfe0a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.887912] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8212860b-a637-49cb-8962-1873e76bfe0a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.048994] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: SUCCESS [ 711.049231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.049391] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.050637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.050637] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.050637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.050637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.050637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.050637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.050637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.050637] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.099577] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 711.099577] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae deletion is rescheduled due to dependency. [ 711.099691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.100605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.100605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.100605] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.100605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.100783] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.100812] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.100968] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.101075] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.393891] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8212860b-a637-49cb-8962-1873e76bfe0a [ 711.393891] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.393891] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.393891] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.393891] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.393891] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.393891] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8212860b-a637-49cb-8962-1873e76bfe0a already deleted. [ 711.393891] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8212860b-a637-49cb-8962-1873e76bfe0a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.557178] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.557178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.557178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.557178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.557178] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.557454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.557454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.557534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.557793] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.557793] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.557956] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.558187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.558187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.558249] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.559053] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.559053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.559053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.559053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.559053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.559053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.559053] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.604296] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.604544] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.604655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.604999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.605147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.605466] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.605613] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.605709] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.605994] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.606129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.606311] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be updated. [ 711.655470] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.655774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.655774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.656026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.656276] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.669225] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 712.064592] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c162e9c6-1558-4a4a-82d6-88bff0e93b92: rpc.has_security_group_logging(os_id): False [ 712.084649] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.085095] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.085095] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.085188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.085188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.085381] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.085474] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.085536] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.085680] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.085758] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.085951] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.086055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.086118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.086258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.086332] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.086604] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.086604] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.086731] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.086795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.086869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.086951] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 is going to be updated. [ 712.158400] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.158400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.158400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.158400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.158400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.183111] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: IN_PROGRESS for 2s [ 712.766828] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: SUCCESS [ 712.767111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.767381] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.767535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.767663] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.929604] env[69637]: INFO networking_nsxv3.common.synchronization [req-7af97c40-ef5b-40cc-99b6-bd6399d891df req-14f44498-3152-45b8-9036-281e14b8e261 tempest-ServerDiskConfigTestJSON-538739594 tempest-ServerDiskConfigTestJSON-538739594-project-member] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 712.930177] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 712.930513] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.930657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.930725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.930966] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.933274] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.933851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.936135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.936135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.936135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.936135] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.270998] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.271292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.271402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.271746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.271804] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.272973] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.272973] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.272973] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.272973] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.272973] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.272973] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.438338] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.438524] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.438898] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.438898] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.439051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.439250] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.439836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.439836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.439836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.439836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.439836] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 713.466931] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.468426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.468561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.468850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.469162] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.478685] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 713.621922] env[69637]: INFO networking_nsxv3.common.synchronization [None req-5920480a-6ae2-47eb-aa22-2d398f226b0b None None] Enqueued Resource ID: 38612b2a-1857-48d4-a316-0ab71d07a484 with Priority: HIGHEST for action port [ 713.622515] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38612b2a-1857-48d4-a316-0ab71d07a484 with Priority: HIGHEST for action port [ 713.622822] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-38612b2a-1857-48d4-a316-0ab71d07a484 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.622946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38612b2a-1857-48d4-a316-0ab71d07a484" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.627974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38612b2a-1857-48d4-a316-0ab71d07a484" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.627974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38612b2a-1857-48d4-a316-0ab71d07a484" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.627974] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38612b2a-1857-48d4-a316-0ab71d07a484',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.682569] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 713.682758] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae deletion is rescheduled due to dependency. [ 713.682954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.778480] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.780052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.780052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.780444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.780542] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.780697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.780697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.780836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.781333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.781333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.781333] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.781333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.781616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.781616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.781845] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.781845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.781845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.782087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.782087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.782163] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.782212] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.131165] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38612b2a-1857-48d4-a316-0ab71d07a484 [ 714.131437] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.131566] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.131636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.131847] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.131959] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.132073] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38612b2a-1857-48d4-a316-0ab71d07a484 already deleted. [ 714.132161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38612b2a-1857-48d4-a316-0ab71d07a484" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.198946] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: SUCCESS [ 714.199504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.285867] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63016cee-78e5-471f-804a-ad9bcf1b801a: rpc.has_security_group_logging(os_id): False [ 714.303839] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.304019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.304064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.304292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.304385] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.304582] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.304737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.304737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.304898] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.304991] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.305188] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.305288] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.305348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.305490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.306545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.306789] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.306890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.306953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.307143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.307211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.307297] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63016cee-78e5-471f-804a-ad9bcf1b801a is going to be updated. [ 714.363016] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.363016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.363016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.363653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.363877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.378749] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: IN_PROGRESS for 2s [ 714.852653] env[69637]: INFO networking_nsxv3.common.synchronization [req-1d0d459f-478e-4a1c-8157-efef327bbbeb req-e546e02e-24e7-4886-880b-56bb5c62baab tempest-ListServersNegativeTestJSON-710888184 tempest-ListServersNegativeTestJSON-710888184-project-member] Enqueued Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 714.852653] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 714.852653] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.852653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.852653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.852653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.852653] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.852653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.852653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.852653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.852653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.852653] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.881587] env[69637]: INFO networking_nsxv3.common.synchronization [req-4c68d2ef-dde9-4827-9571-1c4c0a4df3bb req-c3ae089a-5919-4f7f-86b4-5f02ebe8739b tempest-ServersV294TestFqdnHostnames-986425398 tempest-ServersV294TestFqdnHostnames-986425398-project-member] Enqueued Resource ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 with Priority: HIGHEST for action security_group_members [ 714.884264] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 with Priority: HIGHEST for action security_group_members [ 714.886974] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bf78cc-b175-4724-9f7a-27b142d3a998 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.886974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.886974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.886974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.886974] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.886974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.886974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.886974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.886974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.886974] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2bf78cc-b175-4724-9f7a-27b142d3a998',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.355293] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.391015] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.391015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.391015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.391258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.391258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.396507] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.396507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.396507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.396507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.396507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.396507] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 already deleted. [ 715.396507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.404174] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-163 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.408356] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-163" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.408356] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-163" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.408697] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-163" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.408956] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.409173] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.409225] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.409438] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.409575] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.409778] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.409911] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.410043] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.410155] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.410415] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.410415] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.410515] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.429846] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.430100] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 715.430170] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.430589] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-163" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.430664] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-47761135-051c-4d94-9a0d-11ddc344632e taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.431233] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-47761135-051c-4d94-9a0d-11ddc344632e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.431233] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-47761135-051c-4d94-9a0d-11ddc344632e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.431338] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-47761135-051c-4d94-9a0d-11ddc344632e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.431508] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47761135-051c-4d94-9a0d-11ddc344632e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.487849] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 715.487849] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac deletion is rescheduled due to dependency. [ 715.487974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.860596] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.938085] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.938217] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.938345] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.938651] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.938806] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.938995] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 47761135-051c-4d94-9a0d-11ddc344632e not found, creating... [ 715.939383] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.939474] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.939578] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.939827] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.940056] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.940567] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.940738] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.940953] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.942094] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.944725] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.944725] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 47761135-051c-4d94-9a0d-11ddc344632e is going to be created. [ 715.962540] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.962856] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.962905] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.963227] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.963480] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.965016] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-47761135-051c-4d94-9a0d-11ddc344632e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.366021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.366377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.366377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.366471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.366535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.366634] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63016cee-78e5-471f-804a-ad9bcf1b801a is going to be updated. [ 716.396379] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: SUCCESS [ 716.396695] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.398714] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.398976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.399077] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.399406] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.399507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.407705] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: IN_PROGRESS for 2s [ 716.834366] env[69637]: INFO networking_nsxv3.common.synchronization [req-4c68d2ef-dde9-4827-9571-1c4c0a4df3bb req-582f9c73-18f7-4363-a16d-572179ca6246 service nova] Enqueued Resource ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 with Priority: HIGHEST for action security_group_rules [ 716.834553] env[69637]: INFO networking_nsxv3.common.synchronization [req-4c68d2ef-dde9-4827-9571-1c4c0a4df3bb req-582f9c73-18f7-4363-a16d-572179ca6246 service nova] Enqueued Resource ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 with Priority: HIGHEST for action security_group_members [ 716.834700] env[69637]: INFO networking_nsxv3.common.synchronization [req-4c68d2ef-dde9-4827-9571-1c4c0a4df3bb req-582f9c73-18f7-4363-a16d-572179ca6246 service nova] Enqueued Resource ID: 47761135-051c-4d94-9a0d-11ddc344632e with Priority: HIGHEST for action port [ 716.834940] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 with Priority: HIGHEST for action security_group_rules [ 716.835085] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 with Priority: HIGHEST for action security_group_members [ 716.835184] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47761135-051c-4d94-9a0d-11ddc344632e with Priority: HIGHEST for action port [ 716.835740] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2bf78cc-b175-4724-9f7a-27b142d3a998 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.835870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.835922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.836171] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.836275] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2bf78cc-b175-4724-9f7a-27b142d3a998',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.837093] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bf78cc-b175-4724-9f7a-27b142d3a998 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.837646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.837724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.837902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.838067] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.838168] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.838233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.838383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.838471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.838568] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2bf78cc-b175-4724-9f7a-27b142d3a998',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.839286] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-47761135-051c-4d94-9a0d-11ddc344632e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.839879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47761135-051c-4d94-9a0d-11ddc344632e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.839879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47761135-051c-4d94-9a0d-11ddc344632e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.839879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47761135-051c-4d94-9a0d-11ddc344632e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.839879] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47761135-051c-4d94-9a0d-11ddc344632e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.343289] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bf78cc-b175-4724-9f7a-27b142d3a998 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.343643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.343643] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2bf78cc-b175-4724-9f7a-27b142d3a998',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.346483] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47761135-051c-4d94-9a0d-11ddc344632e with status ACTIVE [ 717.346483] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.346483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.346483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.346483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.346483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.346483] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.346483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.346483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.346483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.346483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.346483] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.346483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.346483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.348280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.348616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.349018] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47761135-051c-4d94-9a0d-11ddc344632e is going to be updated. [ 717.371870] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.371870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.371870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.372346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.372458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.372644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47761135-051c-4d94-9a0d-11ddc344632e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.426476] env[69637]: INFO networking_nsxv3.common.synchronization [None req-e507c4d8-a24c-4beb-8088-80fde7c25843 None None] Enqueued Resource ID: 75271bbe-c35f-4dd4-b319-6ae83c4efd49 with Priority: HIGHEST for action port [ 717.426476] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75271bbe-c35f-4dd4-b319-6ae83c4efd49 with Priority: HIGHEST for action port [ 717.427011] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-75271bbe-c35f-4dd4-b319-6ae83c4efd49 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.427171] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75271bbe-c35f-4dd4-b319-6ae83c4efd49" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.427210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75271bbe-c35f-4dd4-b319-6ae83c4efd49" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.427772] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75271bbe-c35f-4dd4-b319-6ae83c4efd49" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.427772] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75271bbe-c35f-4dd4-b319-6ae83c4efd49',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.853169] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2bf78cc-b175-4724-9f7a-27b142d3a998',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.877746] env[69637]: INFO networking_nsxv3.common.synchronization [req-ffe98989-9fcf-4127-90ab-42cc2a42315c req-8ca98ccb-b55b-460b-a6eb-7fd4b6d86896 tempest-ListServerFiltersTestJSON-297691074 tempest-ListServerFiltersTestJSON-297691074-project-member] Enqueued Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 717.878063] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 717.878980] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.880033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.880033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.884046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.884046] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.884046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.884046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.884046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.884046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.884046] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.930135] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75271bbe-c35f-4dd4-b319-6ae83c4efd49 [ 717.930135] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.930135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.930135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.930364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.930364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.930440] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75271bbe-c35f-4dd4-b319-6ae83c4efd49 already deleted. [ 717.930504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75271bbe-c35f-4dd4-b319-6ae83c4efd49" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.303334] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-990 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.303334] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-990" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.303334] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-990" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.303334] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-990" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.303334] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.303334] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.303334] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.303334] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.303334] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.303334] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.303895] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.304257] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.307728] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.307728] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.307728] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.307728] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.326234] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.326234] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 718.326234] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.326234] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-990" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.326234] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-24f85420-a715-44fb-9dbb-38261f3a5d55 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.326234] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-24f85420-a715-44fb-9dbb-38261f3a5d55" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.326234] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-24f85420-a715-44fb-9dbb-38261f3a5d55" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.326234] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-24f85420-a715-44fb-9dbb-38261f3a5d55" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.326234] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24f85420-a715-44fb-9dbb-38261f3a5d55',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.360143] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.360143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.360143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.360143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.360143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.360143] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 is going to be created. [ 718.383088] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.383249] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.383321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.383935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.384120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.389567] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.397562] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 in Status: UNINITIALIZED for 2s [ 718.415331] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: SUCCESS [ 718.415403] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.728290] env[69637]: INFO networking_nsxv3.common.synchronization [req-d6a2bb5a-cea5-44b2-bddf-8c851de6f335 req-053923bb-f91c-4843-bb52-3cba72d9c749 tempest-ServersAdminNegativeTestJSON-2061472953 tempest-ServersAdminNegativeTestJSON-2061472953-project-member] Enqueued Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_members [ 718.728874] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_members [ 718.729248] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-552e4f46-9b42-4666-9223-428ed3c3368c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.729367] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.729444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.729656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.729819] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.729918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.729978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.732285] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.732394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.732507] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.833817] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.834116] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.834306] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.834706] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.834972] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.835256] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 24f85420-a715-44fb-9dbb-38261f3a5d55 not found, creating... [ 718.835533] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.835754] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.835889] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.836373] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.836606] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.837159] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.837460] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.837643] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.837999] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.838227] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.838460] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 24f85420-a715-44fb-9dbb-38261f3a5d55 is going to be created. [ 718.857711] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.857984] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.858122] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.858426] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.858725] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.859072] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-24f85420-a715-44fb-9dbb-38261f3a5d55" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.891857] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.234587] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.394979] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.395314] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.395355] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.395600] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.395693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.395807] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 is going to be updated. [ 719.419521] env[69637]: INFO networking_nsxv3.common.synchronization [None req-757a95c3-43bd-4d84-a9ae-c7b9f0cb9f2b None None] Enqueued Resource ID: 7a119dc8-654f-461a-bee0-d184221a231c with Priority: HIGHEST for action port [ 719.420168] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a119dc8-654f-461a-bee0-d184221a231c with Priority: HIGHEST for action port [ 719.420345] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a119dc8-654f-461a-bee0-d184221a231c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.420470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a119dc8-654f-461a-bee0-d184221a231c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.420530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a119dc8-654f-461a-bee0-d184221a231c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.423059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a119dc8-654f-461a-bee0-d184221a231c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.423178] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a119dc8-654f-461a-bee0-d184221a231c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.424894] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.425031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.425105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.425347] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.425439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.433637] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: IN_PROGRESS for 2s [ 719.737419] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.887325] env[69637]: INFO networking_nsxv3.common.synchronization [req-ffe98989-9fcf-4127-90ab-42cc2a42315c req-08e50ed6-3cde-437f-b0fd-eb24ddf14fa9 service nova] Enqueued Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_rules [ 719.887491] env[69637]: INFO networking_nsxv3.common.synchronization [req-ffe98989-9fcf-4127-90ab-42cc2a42315c req-08e50ed6-3cde-437f-b0fd-eb24ddf14fa9 service nova] Enqueued Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 719.887620] env[69637]: INFO networking_nsxv3.common.synchronization [req-ffe98989-9fcf-4127-90ab-42cc2a42315c req-08e50ed6-3cde-437f-b0fd-eb24ddf14fa9 service nova] Enqueued Resource ID: 24f85420-a715-44fb-9dbb-38261f3a5d55 with Priority: HIGHEST for action port [ 719.891777] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_rules [ 719.891777] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 719.891777] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24f85420-a715-44fb-9dbb-38261f3a5d55 with Priority: HIGHEST for action port [ 719.891990] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.891990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.897018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.897018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.897018] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.897018] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.897018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.897018] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-24f85420-a715-44fb-9dbb-38261f3a5d55 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.897018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24f85420-a715-44fb-9dbb-38261f3a5d55" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.897018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24f85420-a715-44fb-9dbb-38261f3a5d55" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.897401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24f85420-a715-44fb-9dbb-38261f3a5d55" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.897401] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24f85420-a715-44fb-9dbb-38261f3a5d55',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.928153] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a119dc8-654f-461a-bee0-d184221a231c [ 719.928371] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.928487] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.928553] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.928759] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.928844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.930983] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a119dc8-654f-461a-bee0-d184221a231c already deleted. [ 719.930983] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a119dc8-654f-461a-bee0-d184221a231c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.243501] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.243501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.243501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.243501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.243501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.243501] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 552e4f46-9b42-4666-9223-428ed3c3368c is going to be updated. [ 720.272173] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.272173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.272173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.272173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.272173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.279831] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 552e4f46-9b42-4666-9223-428ed3c3368c in Status: IN_PROGRESS for 2s [ 720.400338] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.400630] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.400685] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24f85420-a715-44fb-9dbb-38261f3a5d55 with status ACTIVE [ 720.400910] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.401057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.401111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.401304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.401404] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.401577] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.401682] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.401776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.402012] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.402164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.402297] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.402498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.402498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.402612] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.402803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.402803] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24f85420-a715-44fb-9dbb-38261f3a5d55 is going to be updated. [ 720.412801] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 in Status: SUCCESS [ 720.413945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.413945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.413945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.413945] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.413945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.413945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.413945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.414230] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.414997] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.415170] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2bf78cc-b175-4724-9f7a-27b142d3a998',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.422820] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.422820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.422820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.422820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.422820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.423230] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24f85420-a715-44fb-9dbb-38261f3a5d55" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.917190] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2bf78cc-b175-4724-9f7a-27b142d3a998',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.029185] env[69637]: INFO networking_nsxv3.common.synchronization [None req-f3955026-4f6e-4468-976e-97478232df4b None None] Enqueued Resource ID: 7c97e96e-48dd-48a4-bdc0-5c7c1dfa7495 with Priority: HIGHEST for action port [ 721.029185] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c97e96e-48dd-48a4-bdc0-5c7c1dfa7495 with Priority: HIGHEST for action port [ 721.030306] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c97e96e-48dd-48a4-bdc0-5c7c1dfa7495 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.030780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c97e96e-48dd-48a4-bdc0-5c7c1dfa7495" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.030780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c97e96e-48dd-48a4-bdc0-5c7c1dfa7495" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.031036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c97e96e-48dd-48a4-bdc0-5c7c1dfa7495" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.031119] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c97e96e-48dd-48a4-bdc0-5c7c1dfa7495',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.422767] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2bf78cc-b175-4724-9f7a-27b142d3a998: rpc.has_security_group_logging(os_id): False [ 721.443683] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: SUCCESS [ 721.445128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.445128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.445128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.445128] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.445128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.445128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.445128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.445128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.445128] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.449431] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.449431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.449431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.449431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.449431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.449431] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.449431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.449431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.449431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.449431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.449431] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 is going to be created. [ 721.508231] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.509225] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.510936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.510936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.510936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.523234] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 in Status: IN_PROGRESS for 2s [ 721.534638] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c97e96e-48dd-48a4-bdc0-5c7c1dfa7495 [ 721.534638] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.534638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.534638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.534638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.534638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.534638] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c97e96e-48dd-48a4-bdc0-5c7c1dfa7495 already deleted. [ 721.534638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c97e96e-48dd-48a4-bdc0-5c7c1dfa7495" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.559162] env[69637]: INFO networking_nsxv3.common.synchronization [req-2e523546-585d-4aa6-8a0b-92c1f97bdf6f req-43fa1bbd-82fc-451d-a086-105cbe1a2a35 tempest-ListImageFiltersTestJSON-1967239197 tempest-ListImageFiltersTestJSON-1967239197-project-member] Enqueued Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_members [ 721.559768] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_members [ 721.560456] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed080368-c954-48e2-a0f1-c55ff7a728fd taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.560456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.560456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.560762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.560762] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.560869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.560869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.561014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.563158] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.565429] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.955176] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.071551] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.071768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.071840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.072156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.072259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.072473] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.072569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.072627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.072795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.072872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.072954] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed080368-c954-48e2-a0f1-c55ff7a728fd already deleted. [ 722.073048] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.290076] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 552e4f46-9b42-4666-9223-428ed3c3368c in Status: SUCCESS [ 722.290456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.458989] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.538437] env[69637]: INFO networking_nsxv3.common.synchronization [None req-697ef2c2-2968-479d-b14f-853e7c02c163 None None] Enqueued Resource ID: e14410f0-7cc3-42fc-a6c7-5dbd1d3d76bd with Priority: HIGHEST for action port [ 722.538727] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e14410f0-7cc3-42fc-a6c7-5dbd1d3d76bd with Priority: HIGHEST for action port [ 722.543782] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-e14410f0-7cc3-42fc-a6c7-5dbd1d3d76bd taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.543782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e14410f0-7cc3-42fc-a6c7-5dbd1d3d76bd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.543782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e14410f0-7cc3-42fc-a6c7-5dbd1d3d76bd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.543782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e14410f0-7cc3-42fc-a6c7-5dbd1d3d76bd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.543782] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e14410f0-7cc3-42fc-a6c7-5dbd1d3d76bd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.763581] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.764027] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.765024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.765524] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.766184] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.766492] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.772332] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.772332] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.772332] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.772332] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.772332] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.772332] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.772332] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.772332] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.772332] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.772332] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.789450] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.789450] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 722.789450] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.789450] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.789612] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-ba764f60-a706-40d9-9e74-711dd33319d4 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.789737] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-ba764f60-a706-40d9-9e74-711dd33319d4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.789884] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-ba764f60-a706-40d9-9e74-711dd33319d4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.790407] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-ba764f60-a706-40d9-9e74-711dd33319d4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.790585] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba764f60-a706-40d9-9e74-711dd33319d4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.961895] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.962071] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.965020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.965020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.965020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.965020] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 is going to be updated. [ 722.994054] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.994226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.994297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.994517] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.995186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.003802] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: IN_PROGRESS for 2s [ 723.044912] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e14410f0-7cc3-42fc-a6c7-5dbd1d3d76bd [ 723.045247] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.045419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.045531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.045752] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.045843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.045937] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e14410f0-7cc3-42fc-a6c7-5dbd1d3d76bd already deleted. [ 723.046023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e14410f0-7cc3-42fc-a6c7-5dbd1d3d76bd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.295963] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.296238] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.296386] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.296665] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.296813] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.296991] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port ba764f60-a706-40d9-9e74-711dd33319d4 not found, creating... [ 723.297298] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.297473] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.297622] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.297828] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.297982] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.298614] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.298614] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.298614] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.298897] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.299013] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.299845] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: ba764f60-a706-40d9-9e74-711dd33319d4 is going to be created. [ 723.320970] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.321305] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.321391] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.321675] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.321933] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.322234] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-ba764f60-a706-40d9-9e74-711dd33319d4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.485147] env[69637]: INFO networking_nsxv3.common.synchronization [None req-e44c46da-c058-466d-be1c-fde4ffd388c0 None None] Enqueued Resource ID: 35e5af7b-f9a8-473d-b099-c33c311a27f9 with Priority: HIGHEST for action port [ 723.485147] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e5af7b-f9a8-473d-b099-c33c311a27f9 with Priority: HIGHEST for action port [ 723.485147] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-35e5af7b-f9a8-473d-b099-c33c311a27f9 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.485147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35e5af7b-f9a8-473d-b099-c33c311a27f9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.485147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35e5af7b-f9a8-473d-b099-c33c311a27f9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.486115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35e5af7b-f9a8-473d-b099-c33c311a27f9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.486546] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35e5af7b-f9a8-473d-b099-c33c311a27f9',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.535527] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 in Status: SUCCESS [ 723.535949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.990424] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35e5af7b-f9a8-473d-b099-c33c311a27f9 [ 723.991540] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.992732] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.992904] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.993573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.995193] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.995312] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35e5af7b-f9a8-473d-b099-c33c311a27f9 already deleted. [ 723.995412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35e5af7b-f9a8-473d-b099-c33c311a27f9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.606374] env[69637]: INFO networking_nsxv3.common.synchronization [None req-9eb73027-badb-4ca0-bd1a-75e78cd9f299 tempest-ServerActionsTestOtherA-1708466346 tempest-ServerActionsTestOtherA-1708466346-project-member] Enqueued Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_rules [ 724.606942] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_rules [ 724.607310] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69c7681d-644f-47c6-8228-9fc17f49b5a3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.607469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.607571] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.607831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.612707] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.737694] env[69637]: INFO networking_nsxv3.common.synchronization [None req-8f19180b-3af4-4e97-9ce6-9dabd5f68a26 tempest-ServerActionsTestOtherA-1708466346 tempest-ServerActionsTestOtherA-1708466346-project-member] Enqueued Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_rules [ 724.738248] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_rules [ 724.738560] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69c7681d-644f-47c6-8228-9fc17f49b5a3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.738715] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.014527] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: SUCCESS [ 725.017055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.017055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.017055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.017055] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.017055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.017055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.017055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.017055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.017055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.017055] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.055524] env[69637]: INFO networking_nsxv3.common.synchronization [req-2e523546-585d-4aa6-8a0b-92c1f97bdf6f req-e2b00d27-b681-406c-a7cf-58a9a4851cdf service nova] Enqueued Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_rules [ 725.055725] env[69637]: INFO networking_nsxv3.common.synchronization [req-2e523546-585d-4aa6-8a0b-92c1f97bdf6f req-e2b00d27-b681-406c-a7cf-58a9a4851cdf service nova] Enqueued Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_members [ 725.055793] env[69637]: INFO networking_nsxv3.common.synchronization [req-2e523546-585d-4aa6-8a0b-92c1f97bdf6f req-e2b00d27-b681-406c-a7cf-58a9a4851cdf service nova] Enqueued Resource ID: ba764f60-a706-40d9-9e74-711dd33319d4 with Priority: HIGHEST for action port [ 725.055991] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_rules [ 725.056147] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_members [ 725.056241] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba764f60-a706-40d9-9e74-711dd33319d4 with Priority: HIGHEST for action port [ 725.056953] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed080368-c954-48e2-a0f1-c55ff7a728fd taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.058247] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.059108] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.059446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.059560] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.060511] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed080368-c954-48e2-a0f1-c55ff7a728fd taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.062515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.062629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.062858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.063079] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.063217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.063331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.063531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.063642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.064243] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.065501] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba764f60-a706-40d9-9e74-711dd33319d4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.065583] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba764f60-a706-40d9-9e74-711dd33319d4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.065651] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba764f60-a706-40d9-9e74-711dd33319d4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.065820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba764f60-a706-40d9-9e74-711dd33319d4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.065894] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba764f60-a706-40d9-9e74-711dd33319d4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.133324] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.133324] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.133324] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.133324] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.133324] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.133324] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 already deleted. [ 725.133552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.133552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.133746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.133808] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.521917] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.521917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.521917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.521917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.521917] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.522433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.522433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.522433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.523141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.523282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.523476] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.523574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.523636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.523806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.523949] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.524053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.524192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.524253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.524365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.524420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.525608] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.567990] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.570818] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed080368-c954-48e2-a0f1-c55ff7a728fd taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.570963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.571527] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba764f60-a706-40d9-9e74-711dd33319d4 with status ACTIVE [ 725.571861] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.571978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.572062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.572420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.572619] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.572902] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.573024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.573348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.573545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.573631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.573928] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.574060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.574315] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.574382] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.574461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.574590] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba764f60-a706-40d9-9e74-711dd33319d4 is going to be updated. [ 725.591465] env[69637]: INFO networking_nsxv3.common.synchronization [None req-d9a514fe-d0c8-43de-a406-7bd06bfa5a82 None None] Enqueued Resource ID: 52b4a86c-891a-4d6d-9700-d42899069ba0 with Priority: HIGHEST for action port [ 725.591728] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52b4a86c-891a-4d6d-9700-d42899069ba0 with Priority: HIGHEST for action port [ 725.592340] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-52b4a86c-891a-4d6d-9700-d42899069ba0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.592693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52b4a86c-891a-4d6d-9700-d42899069ba0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.592780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52b4a86c-891a-4d6d-9700-d42899069ba0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.593067] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52b4a86c-891a-4d6d-9700-d42899069ba0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.593158] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52b4a86c-891a-4d6d-9700-d42899069ba0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.596700] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.596848] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.596901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.597385] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.597855] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.598085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba764f60-a706-40d9-9e74-711dd33319d4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.633569] env[69637]: INFO networking_nsxv3.common.synchronization [None req-de71a939-96dc-4812-8827-96cfcc2ba5ed None None] Enqueued Resource ID: 3a01ffe2-c68c-4423-8850-38c38c3b2e82 with Priority: HIGHEST for action port [ 725.634331] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a01ffe2-c68c-4423-8850-38c38c3b2e82 with Priority: HIGHEST for action port [ 725.634935] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a01ffe2-c68c-4423-8850-38c38c3b2e82 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.635324] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a01ffe2-c68c-4423-8850-38c38c3b2e82" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.635395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a01ffe2-c68c-4423-8850-38c38c3b2e82" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.635909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a01ffe2-c68c-4423-8850-38c38c3b2e82" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.636075] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a01ffe2-c68c-4423-8850-38c38c3b2e82',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.658011] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.658011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.658011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.658011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.658011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.658011] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 already deleted. [ 725.658011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.028243] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c162e9c6-1558-4a4a-82d6-88bff0e93b92: rpc.has_security_group_logging(os_id): False [ 726.051478] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.051478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.051478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.051478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.051478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.051478] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.051478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.051478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.051478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.051478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.051478] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.051478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.051478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.051478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.051478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.053568] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.053568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.053568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.053568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.053568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.053568] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 is going to be updated. [ 726.074162] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.099661] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52b4a86c-891a-4d6d-9700-d42899069ba0 [ 726.099884] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.100018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.100979] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.100979] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.100979] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.100979] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52b4a86c-891a-4d6d-9700-d42899069ba0 already deleted. [ 726.100979] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52b4a86c-891a-4d6d-9700-d42899069ba0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.107320] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.107320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.107320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.107320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.107320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.121185] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: IN_PROGRESS for 2s [ 726.140293] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a01ffe2-c68c-4423-8850-38c38c3b2e82 [ 726.140293] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.140293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.140293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.140293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.140293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.140293] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a01ffe2-c68c-4423-8850-38c38c3b2e82 already deleted. [ 726.140293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a01ffe2-c68c-4423-8850-38c38c3b2e82" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.413974] env[69637]: INFO networking_nsxv3.common.synchronization [None req-b89c9448-d53a-47ff-b1ef-3b0555667097 None None] Enqueued Resource ID: 5393dbf8-b108-4f80-8cac-800974955f38 with Priority: HIGHEST for action port [ 726.413974] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5393dbf8-b108-4f80-8cac-800974955f38 with Priority: HIGHEST for action port [ 726.414273] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5393dbf8-b108-4f80-8cac-800974955f38 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.414332] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5393dbf8-b108-4f80-8cac-800974955f38" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.414362] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5393dbf8-b108-4f80-8cac-800974955f38" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.416763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5393dbf8-b108-4f80-8cac-800974955f38" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.416763] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5393dbf8-b108-4f80-8cac-800974955f38',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.437915] env[69637]: INFO networking_nsxv3.common.synchronization [req-f7eeef53-8adc-4b76-88a6-d458c346bfc9 req-a3cce7c7-a70c-4caf-9418-bce3d4bf88ef tempest-ListImageFiltersTestJSON-1967239197 tempest-ListImageFiltersTestJSON-1967239197-project-member] Enqueued Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_members [ 726.438533] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_members [ 726.439196] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed080368-c954-48e2-a0f1-c55ff7a728fd taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.439333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.578709] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.578709] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.578709] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.578709] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.578907] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.578907] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed080368-c954-48e2-a0f1-c55ff7a728fd is going to be created. [ 726.607454] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.607542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.607606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.610631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.610631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.616536] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed080368-c954-48e2-a0f1-c55ff7a728fd in Status: UNINITIALIZED for 2s [ 726.918309] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5393dbf8-b108-4f80-8cac-800974955f38 [ 726.918588] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.918787] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.918837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.919125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.919247] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.919363] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5393dbf8-b108-4f80-8cac-800974955f38 already deleted. [ 726.919497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5393dbf8-b108-4f80-8cac-800974955f38" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.175483] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.175841] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.175841] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.177157] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.177157] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.177157] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.177157] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.177157] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.177157] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.177584] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.177584] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.177584] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.177687] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.177716] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.177859] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.177972] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.198961] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.199268] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 727.199402] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.199633] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.199980] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-438a3e37-3edc-4ca5-a8e9-46bc5990c868 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.200175] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-438a3e37-3edc-4ca5-a8e9-46bc5990c868" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.200298] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-438a3e37-3edc-4ca5-a8e9-46bc5990c868" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.200734] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-438a3e37-3edc-4ca5-a8e9-46bc5990c868" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.201034] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('438a3e37-3edc-4ca5-a8e9-46bc5990c868',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.704516] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.704516] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.704715] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.704874] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.705142] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.705193] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 438a3e37-3edc-4ca5-a8e9-46bc5990c868 not found, creating... [ 727.705435] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.705582] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.705707] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.705941] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.706102] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.706381] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.706524] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.707409] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.707409] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.707517] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.707625] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 438a3e37-3edc-4ca5-a8e9-46bc5990c868 is going to be created. [ 727.727034] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.728341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.728482] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.728768] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.729048] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.729340] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-438a3e37-3edc-4ca5-a8e9-46bc5990c868" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.134035] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: SUCCESS [ 728.134303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.229540] env[69637]: INFO networking_nsxv3.common.synchronization [None req-45f89f0d-d7f7-4b13-948c-d85c71ac91cc None None] Enqueued Resource ID: ebfa9c0b-17cc-4e64-94ba-c3b534000c83 with Priority: HIGHEST for action port [ 728.229540] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfa9c0b-17cc-4e64-94ba-c3b534000c83 with Priority: HIGHEST for action port [ 728.230141] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebfa9c0b-17cc-4e64-94ba-c3b534000c83 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.230513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebfa9c0b-17cc-4e64-94ba-c3b534000c83" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.231851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebfa9c0b-17cc-4e64-94ba-c3b534000c83" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.231851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebfa9c0b-17cc-4e64-94ba-c3b534000c83" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.231851] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebfa9c0b-17cc-4e64-94ba-c3b534000c83',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.383352] env[69637]: INFO networking_nsxv3.common.synchronization [req-133a91b6-2e12-4c93-a9c7-cae81290abc1 req-0a0704b8-474e-4a53-86bf-79762d8be234 tempest-SecurityGroupRulesTestJSON-480045798 tempest-SecurityGroupRulesTestJSON-480045798-project-member] Enqueued Resource ID: fb934af4-cc57-4b4a-99ea-733ed6d2f2f5 with Priority: HIGHEST for action security_group_rules [ 728.383931] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb934af4-cc57-4b4a-99ea-733ed6d2f2f5 with Priority: HIGHEST for action security_group_rules [ 728.384267] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb934af4-cc57-4b4a-99ea-733ed6d2f2f5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.384403] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb934af4-cc57-4b4a-99ea-733ed6d2f2f5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.384477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb934af4-cc57-4b4a-99ea-733ed6d2f2f5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.384719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb934af4-cc57-4b4a-99ea-733ed6d2f2f5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.384801] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb934af4-cc57-4b4a-99ea-733ed6d2f2f5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.444787] env[69637]: INFO networking_nsxv3.common.synchronization [None req-0dc83eff-b959-4e89-a689-fc0e139942b9 None None] Enqueued Resource ID: 83828d8f-1ea3-4096-b4e1-b53aa29d38c9 with Priority: HIGHEST for action port [ 728.445330] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83828d8f-1ea3-4096-b4e1-b53aa29d38c9 with Priority: HIGHEST for action port [ 728.445653] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-83828d8f-1ea3-4096-b4e1-b53aa29d38c9 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.445749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83828d8f-1ea3-4096-b4e1-b53aa29d38c9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.445821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83828d8f-1ea3-4096-b4e1-b53aa29d38c9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.446102] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83828d8f-1ea3-4096-b4e1-b53aa29d38c9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.446239] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83828d8f-1ea3-4096-b4e1-b53aa29d38c9',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.628175] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed080368-c954-48e2-a0f1-c55ff7a728fd in Status: SUCCESS [ 728.628456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.628561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.628765] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.628993] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.629106] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.629188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.629347] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.629432] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.629520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.629614] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.630469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.630639] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.630801] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.630890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.630955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.631278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.631727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.631827] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.731667] env[69637]: INFO networking_nsxv3.common.synchronization [req-f7eeef53-8adc-4b76-88a6-d458c346bfc9 req-f7778aa9-3072-4c4c-a967-35bcd70194fe service nova] Enqueued Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_rules [ 728.731667] env[69637]: INFO networking_nsxv3.common.synchronization [req-f7eeef53-8adc-4b76-88a6-d458c346bfc9 req-f7778aa9-3072-4c4c-a967-35bcd70194fe service nova] Enqueued Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_members [ 728.731667] env[69637]: INFO networking_nsxv3.common.synchronization [req-f7eeef53-8adc-4b76-88a6-d458c346bfc9 req-f7778aa9-3072-4c4c-a967-35bcd70194fe service nova] Enqueued Resource ID: 438a3e37-3edc-4ca5-a8e9-46bc5990c868 with Priority: HIGHEST for action port [ 728.731667] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_rules [ 728.731667] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_members [ 728.731667] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 438a3e37-3edc-4ca5-a8e9-46bc5990c868 with Priority: HIGHEST for action port [ 728.732012] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed080368-c954-48e2-a0f1-c55ff7a728fd taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.732012] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.734036] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed080368-c954-48e2-a0f1-c55ff7a728fd taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.734036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.734036] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-438a3e37-3edc-4ca5-a8e9-46bc5990c868 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.734036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-438a3e37-3edc-4ca5-a8e9-46bc5990c868" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.734036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-438a3e37-3edc-4ca5-a8e9-46bc5990c868" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.734036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-438a3e37-3edc-4ca5-a8e9-46bc5990c868" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.734036] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('438a3e37-3edc-4ca5-a8e9-46bc5990c868',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.740398] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebfa9c0b-17cc-4e64-94ba-c3b534000c83 [ 728.740398] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.740398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.740398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.740398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.740398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.740398] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebfa9c0b-17cc-4e64-94ba-c3b534000c83 already deleted. [ 728.740398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebfa9c0b-17cc-4e64-94ba-c3b534000c83" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.746062] env[69637]: INFO networking_nsxv3.common.synchronization [None req-2ace4ee8-6f2d-4855-8852-f2c1d21e98f6 tempest-AttachInterfacesUnderV243Test-1189967474 tempest-AttachInterfacesUnderV243Test-1189967474-project-member] Enqueued Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_rules [ 728.746062] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_rules [ 728.746062] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.746062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.746062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.749572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.749572] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.910502] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.910844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.910844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.910974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.912549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.912549] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb934af4-cc57-4b4a-99ea-733ed6d2f2f5 already deleted. [ 728.912549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb934af4-cc57-4b4a-99ea-733ed6d2f2f5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.950115] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83828d8f-1ea3-4096-b4e1-b53aa29d38c9 [ 728.950442] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.950620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.950721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.950997] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.951256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.951393] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83828d8f-1ea3-4096-b4e1-b53aa29d38c9 already deleted. [ 728.951524] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83828d8f-1ea3-4096-b4e1-b53aa29d38c9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.959566] env[69637]: INFO networking_nsxv3.common.synchronization [None req-faee0a00-262e-4d52-8532-f9cd9e37492e tempest-AttachInterfacesUnderV243Test-1189967474 tempest-AttachInterfacesUnderV243Test-1189967474-project-member] Enqueued Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_rules [ 728.960299] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_rules [ 728.960760] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.963024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.014990] env[69637]: INFO networking_nsxv3.common.synchronization [req-ff4bdf43-dc90-4cc0-9bca-ec77321eea64 req-0630a09d-32ac-4351-aa98-eaf40f7d43ff tempest-ServersAdminTestJSON-567435686 tempest-ServersAdminTestJSON-567435686-project-member] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 729.019149] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 729.019149] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.019149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.019149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.019149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.019149] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.019149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.019149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.019149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.019149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.019149] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.134428] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed080368-c954-48e2-a0f1-c55ff7a728fd taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.134428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.135792] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.246306] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 438a3e37-3edc-4ca5-a8e9-46bc5990c868 with status ACTIVE [ 729.246306] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.246306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.246306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.246306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.246306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.246306] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.246306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.246306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.246306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.246306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.246306] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.246306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.246306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.246306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.246306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.246306] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 438a3e37-3edc-4ca5-a8e9-46bc5990c868 is going to be updated. [ 729.268759] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.269503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.269669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.270038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.270292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.270483] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b419c77-3987-4359-99fb-b76e7165ba63 already deleted. [ 729.270633] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.270879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.271175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.271351] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.274101] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.274101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.274101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.274299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.274402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.274597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-438a3e37-3edc-4ca5-a8e9-46bc5990c868" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.521782] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.521995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.522046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.522410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.522410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.522672] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.523338] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.523338] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.523714] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.523714] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.524652] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 already deleted. [ 729.524983] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.575840] env[69637]: INFO networking_nsxv3.common.synchronization [req-ec826d82-ba04-4c81-9517-9a532e40f3ea req-932c7cc1-4467-4cf9-9454-2e12ef90ad93 tempest-SecurityGroupRulesTestJSON-480045798 tempest-SecurityGroupRulesTestJSON-480045798-project-member] Enqueued Resource ID: 3d529be8-5984-4bb0-8de4-c741b20487f7 with Priority: HIGHEST for action security_group_rules [ 729.576610] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d529be8-5984-4bb0-8de4-c741b20487f7 with Priority: HIGHEST for action security_group_rules [ 729.576697] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d529be8-5984-4bb0-8de4-c741b20487f7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.576777] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d529be8-5984-4bb0-8de4-c741b20487f7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.576848] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d529be8-5984-4bb0-8de4-c741b20487f7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.577153] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d529be8-5984-4bb0-8de4-c741b20487f7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.577226] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d529be8-5984-4bb0-8de4-c741b20487f7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.638668] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.793925] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.794097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.795517] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.795598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.795716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.795801] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b419c77-3987-4359-99fb-b76e7165ba63 already deleted. [ 729.795886] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.102766] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.102918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.102978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.103255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.103360] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.103477] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d529be8-5984-4bb0-8de4-c741b20487f7 already deleted. [ 730.103557] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d529be8-5984-4bb0-8de4-c741b20487f7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.117186] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-255 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.117358] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.117495] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.117830] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.118353] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.118897] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.119058] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.119347] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.119529] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.119736] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 730.119851] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.119958] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.120141] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.120195] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 730.120304] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.120433] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.136429] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.136846] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 730.136984] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.137249] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.137784] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-5082334d-987c-4cdd-b382-30b66c4f297a taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.138113] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-5082334d-987c-4cdd-b382-30b66c4f297a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.138233] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-5082334d-987c-4cdd-b382-30b66c4f297a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.138602] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-5082334d-987c-4cdd-b382-30b66c4f297a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.138795] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5082334d-987c-4cdd-b382-30b66c4f297a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.143716] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.143716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.143716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.143716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.143716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.143716] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed080368-c954-48e2-a0f1-c55ff7a728fd is going to be updated. [ 730.166356] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.166452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.166452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.167819] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.167819] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.175420] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed080368-c954-48e2-a0f1-c55ff7a728fd in Status: IN_PROGRESS for 2s [ 730.642120] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.642390] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.642617] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.642906] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.643067] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.644691] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 5082334d-987c-4cdd-b382-30b66c4f297a not found, creating... [ 730.644691] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.644691] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.644691] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.644691] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.644691] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.644691] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.644691] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.645662] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.645662] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.645662] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.645662] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 5082334d-987c-4cdd-b382-30b66c4f297a is going to be created. [ 730.668141] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.668307] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.668754] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.668754] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.668942] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.669676] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-5082334d-987c-4cdd-b382-30b66c4f297a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.879264] env[69637]: INFO networking_nsxv3.common.synchronization [req-3d2e58f2-1767-4ecd-9cd6-b1b4b03161d9 req-851072f0-0673-4984-83a7-9306d95a5cda tempest-SecurityGroupRulesTestJSON-480045798 tempest-SecurityGroupRulesTestJSON-480045798-project-member] Enqueued Resource ID: 0522bf0b-a1b3-4d58-9a54-ce793cd779d7 with Priority: HIGHEST for action security_group_rules [ 730.879782] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0522bf0b-a1b3-4d58-9a54-ce793cd779d7 with Priority: HIGHEST for action security_group_rules [ 730.880096] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0522bf0b-a1b3-4d58-9a54-ce793cd779d7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.880224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0522bf0b-a1b3-4d58-9a54-ce793cd779d7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.880292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0522bf0b-a1b3-4d58-9a54-ce793cd779d7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.880554] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0522bf0b-a1b3-4d58-9a54-ce793cd779d7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.880633] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0522bf0b-a1b3-4d58-9a54-ce793cd779d7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.387789] env[69637]: INFO networking_nsxv3.common.synchronization [req-9a631547-f38c-45af-9582-8de13602ceff req-321a39da-8b1b-4ca0-9468-a77be7fc4d3c tempest-ImagesOneServerTestJSON-1562227752 tempest-ImagesOneServerTestJSON-1562227752-project-member] Enqueued Resource ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 with Priority: HIGHEST for action security_group_members [ 731.388679] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 with Priority: HIGHEST for action security_group_members [ 731.388960] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.389128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.389212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.389417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.389573] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.389671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.389739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.390593] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.390593] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.390593] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e7e0a9c-c4a7-4666-a3e3-3138a89446e5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.402479] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.402643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.402735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.402992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.403192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.403254] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0522bf0b-a1b3-4d58-9a54-ce793cd779d7 already deleted. [ 731.403356] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0522bf0b-a1b3-4d58-9a54-ce793cd779d7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.505098] env[69637]: INFO networking_nsxv3.common.synchronization [req-ff4bdf43-dc90-4cc0-9bca-ec77321eea64 req-9a41626f-5261-490d-9738-e001bbf11dd0 service nova] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_rules [ 731.505098] env[69637]: INFO networking_nsxv3.common.synchronization [req-ff4bdf43-dc90-4cc0-9bca-ec77321eea64 req-9a41626f-5261-490d-9738-e001bbf11dd0 service nova] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 731.505098] env[69637]: INFO networking_nsxv3.common.synchronization [req-ff4bdf43-dc90-4cc0-9bca-ec77321eea64 req-9a41626f-5261-490d-9738-e001bbf11dd0 service nova] Enqueued Resource ID: 5082334d-987c-4cdd-b382-30b66c4f297a with Priority: HIGHEST for action port [ 731.505098] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_rules [ 731.505098] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 731.505098] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5082334d-987c-4cdd-b382-30b66c4f297a with Priority: HIGHEST for action port [ 731.505569] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.505693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.505761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.506021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.506106] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.507373] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.507475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.507524] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.507737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.507899] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.508010] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.508080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.508482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.508482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.508482] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.509501] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5082334d-987c-4cdd-b382-30b66c4f297a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.509501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5082334d-987c-4cdd-b382-30b66c4f297a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.509501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5082334d-987c-4cdd-b382-30b66c4f297a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.509501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5082334d-987c-4cdd-b382-30b66c4f297a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.509712] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5082334d-987c-4cdd-b382-30b66c4f297a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.893236] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.893236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.893236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.893236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.893236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.893557] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.893557] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.893557] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.893736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.893811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.893895] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 is going to be updated. [ 731.923724] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.923724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.923724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.923852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.924174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.932766] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 in Status: IN_PROGRESS for 2s [ 732.013044] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.013044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.013044] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.013044] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5082334d-987c-4cdd-b382-30b66c4f297a with status ACTIVE [ 732.013311] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.013415] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.013449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.013700] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.013736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.013885] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.013981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.014057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.014191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.014258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.014599] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.014599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.014599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.014863] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.014863] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.016057] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5082334d-987c-4cdd-b382-30b66c4f297a is going to be updated. [ 732.035900] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.036018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.036076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.036254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.036394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.036555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5082334d-987c-4cdd-b382-30b66c4f297a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.138986] env[69637]: INFO networking_nsxv3.common.synchronization [req-9a43294c-2349-47c0-b032-cb91ce04606e req-ecd7b6c9-b16b-40d1-a838-77df7e30ca17 tempest-SecurityGroupRulesTestJSON-480045798 tempest-SecurityGroupRulesTestJSON-480045798-project-member] Enqueued Resource ID: bc5405c8-8e62-47f8-989b-706d5716388c with Priority: HIGHEST for action security_group_rules [ 732.139586] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc5405c8-8e62-47f8-989b-706d5716388c with Priority: HIGHEST for action security_group_rules [ 732.139831] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc5405c8-8e62-47f8-989b-706d5716388c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.139954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc5405c8-8e62-47f8-989b-706d5716388c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.140081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc5405c8-8e62-47f8-989b-706d5716388c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.140433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc5405c8-8e62-47f8-989b-706d5716388c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.140433] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc5405c8-8e62-47f8-989b-706d5716388c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.184710] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed080368-c954-48e2-a0f1-c55ff7a728fd in Status: SUCCESS [ 732.184710] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.184921] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.185070] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.185269] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.185376] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.185440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.185630] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.185669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.185769] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.518672] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.660200] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.660334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.660384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.660633] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.660823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.660823] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc5405c8-8e62-47f8-989b-706d5716388c already deleted. [ 732.660921] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc5405c8-8e62-47f8-989b-706d5716388c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.690323] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.021725] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.021946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.021946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.022146] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.022277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.022386] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 is going to be created. [ 733.043256] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.043406] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.043650] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.043748] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.043933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.053319] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: UNINITIALIZED for 2s [ 733.193193] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.661352] env[69637]: INFO networking_nsxv3.common.synchronization [req-5ef02f59-1e44-4644-8011-63daaaa1cde2 req-cf878c40-f59d-4b31-a07c-1735d5197fdc tempest-SecurityGroupRulesTestJSON-480045798 tempest-SecurityGroupRulesTestJSON-480045798-project-member] Enqueued Resource ID: ac166ae6-efdb-4e01-8353-cbbcdcab3c66 with Priority: HIGHEST for action security_group_rules [ 733.662291] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac166ae6-efdb-4e01-8353-cbbcdcab3c66 with Priority: HIGHEST for action security_group_rules [ 733.662903] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac166ae6-efdb-4e01-8353-cbbcdcab3c66 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.663049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac166ae6-efdb-4e01-8353-cbbcdcab3c66" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.663140] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac166ae6-efdb-4e01-8353-cbbcdcab3c66" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.663417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac166ae6-efdb-4e01-8353-cbbcdcab3c66" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.663679] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac166ae6-efdb-4e01-8353-cbbcdcab3c66',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.698569] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.699034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.700294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.700294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.700294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.700294] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed080368-c954-48e2-a0f1-c55ff7a728fd is going to be updated. [ 733.733292] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.733292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.733292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.735127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.735127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.746598] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed080368-c954-48e2-a0f1-c55ff7a728fd in Status: IN_PROGRESS for 2s [ 733.794950] env[69637]: INFO networking_nsxv3.common.synchronization [req-59d5f24d-5be0-419e-bf28-477dd5f9ebf7 req-b1cd587d-357d-40db-be77-27e0968a09f7 tempest-SecurityGroupRulesTestJSON-480045798 tempest-SecurityGroupRulesTestJSON-480045798-project-member] Enqueued Resource ID: ac166ae6-efdb-4e01-8353-cbbcdcab3c66 with Priority: HIGHEST for action security_group_rules [ 733.795720] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac166ae6-efdb-4e01-8353-cbbcdcab3c66 with Priority: HIGHEST for action security_group_rules [ 733.795909] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac166ae6-efdb-4e01-8353-cbbcdcab3c66 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.796901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac166ae6-efdb-4e01-8353-cbbcdcab3c66" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.942033] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 in Status: SUCCESS [ 733.942282] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 deletion is rescheduled due to dependency. [ 733.942415] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.181745] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.181890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.181950] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.182189] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.182322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.182381] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac166ae6-efdb-4e01-8353-cbbcdcab3c66 already deleted. [ 734.183388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac166ae6-efdb-4e01-8353-cbbcdcab3c66" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.183388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac166ae6-efdb-4e01-8353-cbbcdcab3c66" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.183388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac166ae6-efdb-4e01-8353-cbbcdcab3c66" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.183388] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac166ae6-efdb-4e01-8353-cbbcdcab3c66',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.253487] env[69637]: INFO networking_nsxv3.common.synchronization [req-6d65074f-cabd-490f-83fb-2c90e2d7d757 req-b7216ed2-a55f-4ee0-b9df-3c0b99d01098 tempest-SecurityGroupRulesTestJSON-480045798 tempest-SecurityGroupRulesTestJSON-480045798-project-member] Enqueued Resource ID: ac166ae6-efdb-4e01-8353-cbbcdcab3c66 with Priority: HIGHEST for action security_group_rules [ 734.253995] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac166ae6-efdb-4e01-8353-cbbcdcab3c66 with Priority: HIGHEST for action security_group_rules [ 734.254315] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac166ae6-efdb-4e01-8353-cbbcdcab3c66 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.254418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac166ae6-efdb-4e01-8353-cbbcdcab3c66" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.703448] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.703722] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.703722] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.703936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.704041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.704140] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac166ae6-efdb-4e01-8353-cbbcdcab3c66 already deleted. [ 734.704232] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac166ae6-efdb-4e01-8353-cbbcdcab3c66" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.704664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac166ae6-efdb-4e01-8353-cbbcdcab3c66" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.704862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac166ae6-efdb-4e01-8353-cbbcdcab3c66" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.704967] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac166ae6-efdb-4e01-8353-cbbcdcab3c66',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.885037] env[69637]: INFO networking_nsxv3.common.synchronization [req-d146cad0-0e68-42d5-a8a5-762244404520 req-ca22d4fb-adb2-47a9-ad62-235d8635610e tempest-ServersAdminTestJSON-567435686 tempest-ServersAdminTestJSON-567435686-project-member] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 734.885037] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 734.885037] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.885037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.067437] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: SUCCESS [ 735.067437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.067437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.067437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.067437] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.067711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.067711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.069037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.069037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.069037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.069037] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.069979] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.070199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.070525] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.070525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.070616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.070770] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.070850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.070940] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.210948] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-255 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.211948] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.212263] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.212638] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.215020] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.215020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.215020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.215020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.215020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.215020] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.215020] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.215020] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.215020] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.215020] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.215020] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.215020] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.235210] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.238026] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 735.238026] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.238026] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.238026] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-6cc70306-665c-44b9-b941-948e58cee006 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.238026] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-6cc70306-665c-44b9-b941-948e58cee006" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.238026] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-6cc70306-665c-44b9-b941-948e58cee006" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.238026] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-6cc70306-665c-44b9-b941-948e58cee006" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.238026] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cc70306-665c-44b9-b941-948e58cee006',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.241499] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.242495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.242495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.242495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.242495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.242495] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac166ae6-efdb-4e01-8353-cbbcdcab3c66 already deleted. [ 735.242495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac166ae6-efdb-4e01-8353-cbbcdcab3c66" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.571874] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.571874] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.575097] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.742346] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.742662] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.742662] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.743600] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.743600] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.743600] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 6cc70306-665c-44b9-b941-948e58cee006 not found, creating... [ 735.743600] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.743775] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.743868] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.744105] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.744244] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.744555] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.745569] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.745908] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.746725] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.747521] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.747521] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 6cc70306-665c-44b9-b941-948e58cee006 is going to be created. [ 735.759284] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed080368-c954-48e2-a0f1-c55ff7a728fd in Status: SUCCESS [ 735.760824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.760824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.760824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.760824] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.761292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.761501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.762659] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.763044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.766118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.766118] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed080368-c954-48e2-a0f1-c55ff7a728fd taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.766118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.766118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.766118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.766118] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.766118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.766118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.766118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.766118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.766118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.766118] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.769506] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.769917] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.770959] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.770959] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.770959] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.771302] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-6cc70306-665c-44b9-b941-948e58cee006" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.077143] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.268759] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed080368-c954-48e2-a0f1-c55ff7a728fd: rpc.has_security_group_logging(os_id): False [ 736.289379] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.289532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.289601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.289814] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.289909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.290128] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.290232] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.290299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.290455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.290534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.290718] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.290810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.290874] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.291021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.291099] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.291318] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.291426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.291469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.291615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.291873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.291873] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed080368-c954-48e2-a0f1-c55ff7a728fd is going to be created. [ 736.360382] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.361678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.361678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.361678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.361678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.372599] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed080368-c954-48e2-a0f1-c55ff7a728fd in Status: IN_PROGRESS for 2s [ 736.559115] env[69637]: INFO networking_nsxv3.common.synchronization [req-d146cad0-0e68-42d5-a8a5-762244404520 req-77f0d98a-347b-42eb-a870-3947a3c70c7b service nova] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_rules [ 736.559595] env[69637]: INFO networking_nsxv3.common.synchronization [req-d146cad0-0e68-42d5-a8a5-762244404520 req-77f0d98a-347b-42eb-a870-3947a3c70c7b service nova] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 736.559595] env[69637]: INFO networking_nsxv3.common.synchronization [req-d146cad0-0e68-42d5-a8a5-762244404520 req-77f0d98a-347b-42eb-a870-3947a3c70c7b service nova] Enqueued Resource ID: 6cc70306-665c-44b9-b941-948e58cee006 with Priority: HIGHEST for action port [ 736.559700] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_rules [ 736.559895] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 736.559895] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc70306-665c-44b9-b941-948e58cee006 with Priority: HIGHEST for action port [ 736.560485] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.560588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.560772] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.560856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.561614] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cc70306-665c-44b9-b941-948e58cee006 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.561755] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cc70306-665c-44b9-b941-948e58cee006" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.561824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cc70306-665c-44b9-b941-948e58cee006" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.562043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cc70306-665c-44b9-b941-948e58cee006" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.562129] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cc70306-665c-44b9-b941-948e58cee006',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.579327] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.579464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.579537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.579745] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.579839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.579932] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 is going to be updated. [ 736.608676] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.608781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.608832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.609503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.609503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.619180] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: IN_PROGRESS for 2s [ 737.069502] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6cc70306-665c-44b9-b941-948e58cee006 with status ACTIVE [ 737.069799] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.069882] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.069961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.070212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.070321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.070509] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.070638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.070684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.070829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.070905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.071096] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.071188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.071288] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.071413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.071490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.071577] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6cc70306-665c-44b9-b941-948e58cee006 is going to be updated. [ 737.090794] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.090944] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.090998] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.091169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.091335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.091896] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cc70306-665c-44b9-b941-948e58cee006" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.386806] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed080368-c954-48e2-a0f1-c55ff7a728fd in Status: SUCCESS [ 738.386806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.386806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.386806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.386806] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.634551] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: SUCCESS [ 738.634761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.634930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.635156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.635342] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.635453] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.635514] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.635656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.635735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.635813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.635965] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.636052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.636103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.636245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.636376] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.636474] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.636529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.636658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.636727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.636800] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.636883] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.637871] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.638079] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.638180] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.639027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.639027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.639027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.639027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.639027] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.851572] env[69637]: INFO networking_nsxv3.common.synchronization [None req-d9f70252-bcc4-466d-bfec-50a2f2faad82 None None] Enqueued Resource ID: f8f571c6-4759-4ff7-a364-07b501bfc2a5 with Priority: HIGHEST for action port [ 738.851572] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f571c6-4759-4ff7-a364-07b501bfc2a5 with Priority: HIGHEST for action port [ 738.851572] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8f571c6-4759-4ff7-a364-07b501bfc2a5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.851572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8f571c6-4759-4ff7-a364-07b501bfc2a5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.852128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8f571c6-4759-4ff7-a364-07b501bfc2a5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.852410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8f571c6-4759-4ff7-a364-07b501bfc2a5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.852494] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8f571c6-4759-4ff7-a364-07b501bfc2a5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.890035] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed080368-c954-48e2-a0f1-c55ff7a728fd taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.890035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.890035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.890035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.890391] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.893229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.893319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.893510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.893678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.893791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.895373] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.141964] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff9b407c-6313-458e-a95d-b00d9b8914d1: rpc.has_security_group_logging(os_id): False [ 739.142120] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.163764] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.163764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.163764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.163949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.164153] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.164282] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.164377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.164454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.164668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.164747] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.164929] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.165024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.165093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.165360] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.165360] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.165440] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.165523] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.165607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.165796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.165880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.166281] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 is going to be created. [ 739.221021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.221021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.221160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.221674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.221674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.233022] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: IN_PROGRESS for 2s [ 739.354641] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8f571c6-4759-4ff7-a364-07b501bfc2a5 [ 739.354823] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.355718] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.355718] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.355718] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.355718] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.355718] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8f571c6-4759-4ff7-a364-07b501bfc2a5 already deleted. [ 739.355718] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8f571c6-4759-4ff7-a364-07b501bfc2a5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.399285] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed080368-c954-48e2-a0f1-c55ff7a728fd taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.399555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.399555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.400187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.400187] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.400187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.400187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.400405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.400405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.400459] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.400874] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed080368-c954-48e2-a0f1-c55ff7a728fd taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.400874] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.400874] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.400874] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.401094] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.401094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.401240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.401342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.401417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.402371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.402371] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.646724] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.905332] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed080368-c954-48e2-a0f1-c55ff7a728fd: rpc.has_security_group_logging(os_id): False [ 739.937274] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.937274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.937274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.937274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.937594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.937594] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.937672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.937743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.937925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.938015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.938226] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.938322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.938416] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.938602] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.938691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.938990] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.938990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.939226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.940396] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.940487] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.940577] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed080368-c954-48e2-a0f1-c55ff7a728fd is going to be updated. [ 739.997784] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.997976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.998164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.998422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.998607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.010031] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed080368-c954-48e2-a0f1-c55ff7a728fd in Status: IN_PROGRESS for 2s [ 740.149918] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.149918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.149918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.149918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.150140] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.150140] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 is going to be updated. [ 740.181812] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.181888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.181992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.182182] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.185605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.194243] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: IN_PROGRESS for 2s [ 740.762105] env[69637]: INFO networking_nsxv3.common.synchronization [None req-cc988198-7bd8-42d1-a065-1696c7411dad None None] Enqueued Resource ID: 5ae10fe8-0a6d-4e1b-b449-753918e97069 with Priority: HIGHEST for action port [ 740.762698] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ae10fe8-0a6d-4e1b-b449-753918e97069 with Priority: HIGHEST for action port [ 740.763028] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ae10fe8-0a6d-4e1b-b449-753918e97069 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.763243] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ae10fe8-0a6d-4e1b-b449-753918e97069" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.763243] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ae10fe8-0a6d-4e1b-b449-753918e97069" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.763461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ae10fe8-0a6d-4e1b-b449-753918e97069" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.763542] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ae10fe8-0a6d-4e1b-b449-753918e97069',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.913054] env[69637]: INFO networking_nsxv3.common.synchronization [req-8dfbb8d6-3251-4d8c-9e2c-012001062e95 req-d215d706-e92d-40a9-aa87-ec6d53302b80 tempest-DeleteServersAdminTestJSON-551815227 tempest-DeleteServersAdminTestJSON-551815227-project-member] Enqueued Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_members [ 740.913722] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_members [ 740.914790] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-645e75b0-47c9-44b7-81c7-713e50cf04dc taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.914978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.915129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.915383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.915982] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.916258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.916370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.916607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.916755] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.916910] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.246044] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: SUCCESS [ 741.246978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.247214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.247437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.247525] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.268792] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ae10fe8-0a6d-4e1b-b449-753918e97069 [ 741.269065] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.269213] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.269302] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.269533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.269803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.269803] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ae10fe8-0a6d-4e1b-b449-753918e97069 already deleted. [ 741.269803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ae10fe8-0a6d-4e1b-b449-753918e97069" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.422025] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.422025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.422025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.422025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.422025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.422025] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.422025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.422025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.422025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.422025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.422025] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc is going to be updated. [ 741.445544] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.445617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.445690] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.445914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.446136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.454810] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc in Status: IN_PROGRESS for 2s [ 741.476599] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.476599] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.476784] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.477085] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.477892] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.478123] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.479017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.479017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.479017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.479017] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 741.479017] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 741.479290] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 741.479430] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 741.479640] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 741.480434] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 741.480434] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 741.497692] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 741.497855] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 741.498034] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 741.498208] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.499032] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-928b89c4-ba45-450e-92aa-d6cf974114e0 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.499032] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-928b89c4-ba45-450e-92aa-d6cf974114e0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.499032] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-928b89c4-ba45-450e-92aa-d6cf974114e0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.499249] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-928b89c4-ba45-450e-92aa-d6cf974114e0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.499325] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('928b89c4-ba45-450e-92aa-d6cf974114e0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.757079] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.757079] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.005190] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.005491] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.005568] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.005831] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.005975] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.006136] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 928b89c4-ba45-450e-92aa-d6cf974114e0 not found, creating... [ 742.006387] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.006535] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.006648] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.006851] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.006996] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.007340] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.007492] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.007603] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.007805] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.007925] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.008070] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 928b89c4-ba45-450e-92aa-d6cf974114e0 is going to be created. [ 742.021977] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed080368-c954-48e2-a0f1-c55ff7a728fd in Status: SUCCESS [ 742.022136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.027032] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.027170] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.027247] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.027508] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.027726] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.027936] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-928b89c4-ba45-450e-92aa-d6cf974114e0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.202904] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: SUCCESS [ 742.203097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.203330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.203588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.203843] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.203997] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.204109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.204307] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.204430] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.204539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.204678] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.706906] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.707114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.707188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.707642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.707864] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.707971] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.708095] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.708304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.708401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.708532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.708750] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.708851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.708945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.709113] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.709324] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.709503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.709658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.709821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.709911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.711039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.711039] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.754046] env[69637]: INFO networking_nsxv3.common.synchronization [req-8dfbb8d6-3251-4d8c-9e2c-012001062e95 req-76711bb3-a9a2-4a95-89da-52478219e577 service nova] Enqueued Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_rules [ 742.754266] env[69637]: INFO networking_nsxv3.common.synchronization [req-8dfbb8d6-3251-4d8c-9e2c-012001062e95 req-76711bb3-a9a2-4a95-89da-52478219e577 service nova] Enqueued Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_members [ 742.754408] env[69637]: INFO networking_nsxv3.common.synchronization [req-8dfbb8d6-3251-4d8c-9e2c-012001062e95 req-76711bb3-a9a2-4a95-89da-52478219e577 service nova] Enqueued Resource ID: 928b89c4-ba45-450e-92aa-d6cf974114e0 with Priority: HIGHEST for action port [ 742.755103] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_rules [ 742.755284] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_members [ 742.756125] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928b89c4-ba45-450e-92aa-d6cf974114e0 with Priority: HIGHEST for action port [ 742.756448] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-645e75b0-47c9-44b7-81c7-713e50cf04dc taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.756583] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.756655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.756873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.756960] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.758234] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-645e75b0-47c9-44b7-81c7-713e50cf04dc taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.758377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.758600] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-928b89c4-ba45-450e-92aa-d6cf974114e0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.758687] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-928b89c4-ba45-450e-92aa-d6cf974114e0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.758772] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-928b89c4-ba45-450e-92aa-d6cf974114e0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.758950] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-928b89c4-ba45-450e-92aa-d6cf974114e0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.759050] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('928b89c4-ba45-450e-92aa-d6cf974114e0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.213661] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff9b407c-6313-458e-a95d-b00d9b8914d1: rpc.has_security_group_logging(os_id): False [ 743.231092] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.231280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.231406] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.231637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.231752] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.231992] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.232084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.232171] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.232360] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.232444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.232631] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.232724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.232807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.232972] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.233092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.233274] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.233365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.233439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.233613] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.233719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.234226] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 is going to be updated. [ 743.261156] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-645e75b0-47c9-44b7-81c7-713e50cf04dc taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.261246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.261520] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 928b89c4-ba45-450e-92aa-d6cf974114e0 with status ACTIVE [ 743.261748] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.261879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.262249] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.262249] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.262362] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.262501] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.262633] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.262724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.262910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.263109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.263357] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.263357] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.263478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.263540] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.263648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.263776] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 928b89c4-ba45-450e-92aa-d6cf974114e0 is going to be updated. [ 743.280542] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.280542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.280542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.280542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.280542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.280542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-928b89c4-ba45-450e-92aa-d6cf974114e0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.291216] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.291216] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.291216] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.291216] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.291216] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.305830] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: IN_PROGRESS for 2s [ 743.464566] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc in Status: SUCCESS [ 743.464801] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc deletion is rescheduled due to dependency. [ 743.465067] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.465272] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.465426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.465609] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.465723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.465785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.465926] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.466010] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.466108] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.683855] env[69637]: INFO networking_nsxv3.common.synchronization [req-96720ed8-00ef-468f-b3a2-bcfc511b6627 req-2f069727-0c20-423a-9857-328ada844d33 tempest-ServersTestBootFromVolume-426522910 tempest-ServersTestBootFromVolume-426522910-project-member] Enqueued Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGHEST for action security_group_members [ 743.684548] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGHEST for action security_group_members [ 743.684853] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fb52e9e-114d-48d5-9b9e-c3f299243e92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.684974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.685076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.685362] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.685520] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.685620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.685681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.685870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.685917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.686023] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fb52e9e-114d-48d5-9b9e-c3f299243e92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.969373] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.124841] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-945 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.125071] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-945" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.125204] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-945" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.125560] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-945" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.126292] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.126292] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.127340] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.128967] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.129170] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.129733] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 744.129733] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.129799] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.129902] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.130086] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 744.130169] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.130312] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.147621] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.147832] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 744.148026] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.148243] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-945" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.148591] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-67b91694-b796-4adb-baea-ac85c195fe46 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.148881] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-67b91694-b796-4adb-baea-ac85c195fe46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.149016] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-67b91694-b796-4adb-baea-ac85c195fe46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.149380] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-67b91694-b796-4adb-baea-ac85c195fe46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.149510] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67b91694-b796-4adb-baea-ac85c195fe46',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.191246] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.191457] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.191510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.191737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.191831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.192038] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.192140] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.192207] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.192420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.192547] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.192645] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 already deleted. [ 744.192746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.472370] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.658341] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.658341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.658341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.658341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.658341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.658341] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 67b91694-b796-4adb-baea-ac85c195fe46 not found, creating... [ 744.658341] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.658341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.658341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.658341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.658341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.659605] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.659605] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.659605] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.659605] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.659605] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.659605] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 67b91694-b796-4adb-baea-ac85c195fe46 is going to be created. [ 744.687671] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.687928] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.688127] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.688472] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.688792] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.689062] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-67b91694-b796-4adb-baea-ac85c195fe46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.975449] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.975524] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.975586] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.975879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.976047] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.976208] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc is going to be updated. [ 745.003062] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.003062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.003062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.003062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.003062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.010197] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc in Status: IN_PROGRESS for 2s [ 745.319941] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: SUCCESS [ 745.320182] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.589317] env[69637]: INFO networking_nsxv3.common.synchronization [req-96720ed8-00ef-468f-b3a2-bcfc511b6627 req-08de8a6e-f7ca-4fbc-a2a3-a4293b44441c service nova] Enqueued Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGHEST for action security_group_rules [ 745.589317] env[69637]: INFO networking_nsxv3.common.synchronization [req-96720ed8-00ef-468f-b3a2-bcfc511b6627 req-08de8a6e-f7ca-4fbc-a2a3-a4293b44441c service nova] Enqueued Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGHEST for action security_group_members [ 745.589317] env[69637]: INFO networking_nsxv3.common.synchronization [req-96720ed8-00ef-468f-b3a2-bcfc511b6627 req-08de8a6e-f7ca-4fbc-a2a3-a4293b44441c service nova] Enqueued Resource ID: 67b91694-b796-4adb-baea-ac85c195fe46 with Priority: HIGHEST for action port [ 745.591712] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGHEST for action security_group_rules [ 745.591712] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGHEST for action security_group_members [ 745.591712] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b91694-b796-4adb-baea-ac85c195fe46 with Priority: HIGHEST for action port [ 745.591712] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.591712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.591712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.591712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.591712] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fb52e9e-114d-48d5-9b9e-c3f299243e92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.593718] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fb52e9e-114d-48d5-9b9e-c3f299243e92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.594059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.594247] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.595062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.595473] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.595850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.597041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.597041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.597041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.597041] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fb52e9e-114d-48d5-9b9e-c3f299243e92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.597699] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-67b91694-b796-4adb-baea-ac85c195fe46 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.597950] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67b91694-b796-4adb-baea-ac85c195fe46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.598172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67b91694-b796-4adb-baea-ac85c195fe46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.598423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67b91694-b796-4adb-baea-ac85c195fe46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.598595] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67b91694-b796-4adb-baea-ac85c195fe46',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.094758] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fb52e9e-114d-48d5-9b9e-c3f299243e92 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.094880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.100355] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fb52e9e-114d-48d5-9b9e-c3f299243e92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.101290] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67b91694-b796-4adb-baea-ac85c195fe46 with status ACTIVE [ 746.101549] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.101672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.101741] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.101934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.102037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.102283] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.102423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.102489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.102642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.102725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.102901] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.102993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.107020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.107020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.107020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.107020] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67b91694-b796-4adb-baea-ac85c195fe46 is going to be updated. [ 746.124367] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.124572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.124572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.124775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.124907] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.125071] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67b91694-b796-4adb-baea-ac85c195fe46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.606568] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fb52e9e-114d-48d5-9b9e-c3f299243e92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.019532] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc in Status: SUCCESS [ 747.019859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.020075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.020327] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.020545] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.020718] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.020789] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.020952] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.021046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.021134] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.021225] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.109350] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.109683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.109804] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.110114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.110271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.110438] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 is going to be created. [ 747.133763] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.133977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.134114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.134353] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.134576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.143478] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 in Status: UNINITIALIZED for 2s [ 747.523582] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-645e75b0-47c9-44b7-81c7-713e50cf04dc taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.523963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.524061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.524315] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.524541] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.524709] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.524709] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.524885] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.524972] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.525073] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.525220] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-645e75b0-47c9-44b7-81c7-713e50cf04dc taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.525312] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.525371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.525518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.525671] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.525776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.525819] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.525952] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.526060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.526153] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.526242] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.761262] env[69637]: INFO networking_nsxv3.common.synchronization [req-30322518-9892-45df-98a0-b1b37b4536de req-392c5499-acc3-4990-a568-b88e6d44a0bc tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 747.761979] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 747.762451] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.762582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.762708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.762976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.763299] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.763299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.763627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.763627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.763780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.763780] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.028788] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 645e75b0-47c9-44b7-81c7-713e50cf04dc: rpc.has_security_group_logging(os_id): False [ 748.048092] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.048272] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.048438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.048655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.048749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.048973] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.049084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.049141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.049304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.049399] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.049578] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.049671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.049730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.049868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.049943] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.050135] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.050225] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.050274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.050421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.050500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.050581] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc is going to be updated. [ 748.052968] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-149 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.053168] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.053278] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.053498] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.053748] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.053900] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.054026] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.054239] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.054375] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.054575] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.054689] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.054797] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.054902] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.055014] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.055125] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.055252] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.078816] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.078997] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 748.079128] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.079389] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.079727] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-649b4534-dd4b-4426-977c-50dec84437d2 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.079903] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-649b4534-dd4b-4426-977c-50dec84437d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.080030] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-649b4534-dd4b-4426-977c-50dec84437d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.080366] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-649b4534-dd4b-4426-977c-50dec84437d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.080496] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('649b4534-dd4b-4426-977c-50dec84437d2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.115094] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.115094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.115094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.115094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.115094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.137480] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc in Status: IN_PROGRESS for 2s [ 748.266561] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.266786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.266829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.267065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.267183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.267412] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.267508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.267574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.267730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.267805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.267889] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f already deleted. [ 748.267970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.583366] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.583627] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.583787] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.584103] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.584258] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.584423] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 649b4534-dd4b-4426-977c-50dec84437d2 not found, creating... [ 748.584691] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.584852] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.584968] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.585199] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.585338] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.585622] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.585774] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.585889] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.586106] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.586249] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.586377] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 649b4534-dd4b-4426-977c-50dec84437d2 is going to be created. [ 748.606180] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.606420] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.606544] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.606827] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.607069] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.607296] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-649b4534-dd4b-4426-977c-50dec84437d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.153510] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 in Status: UNINITIALIZED for 4s [ 749.394463] env[69637]: INFO networking_nsxv3.common.synchronization [req-30322518-9892-45df-98a0-b1b37b4536de req-b3c7a36f-d341-41f5-a3e5-c4bb652d29e3 service nova] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_rules [ 749.394463] env[69637]: INFO networking_nsxv3.common.synchronization [req-30322518-9892-45df-98a0-b1b37b4536de req-b3c7a36f-d341-41f5-a3e5-c4bb652d29e3 service nova] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 749.394463] env[69637]: INFO networking_nsxv3.common.synchronization [req-30322518-9892-45df-98a0-b1b37b4536de req-b3c7a36f-d341-41f5-a3e5-c4bb652d29e3 service nova] Enqueued Resource ID: 649b4534-dd4b-4426-977c-50dec84437d2 with Priority: HIGHEST for action port [ 749.394463] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_rules [ 749.394463] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 749.394463] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 649b4534-dd4b-4426-977c-50dec84437d2 with Priority: HIGHEST for action port [ 749.394463] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.398414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.398414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.398414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.398414] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.398414] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.398414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.398414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.398414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.398414] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.398721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.398721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.398721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.398820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.398820] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.400283] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-649b4534-dd4b-4426-977c-50dec84437d2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.400283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-649b4534-dd4b-4426-977c-50dec84437d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.400283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-649b4534-dd4b-4426-977c-50dec84437d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.400504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-649b4534-dd4b-4426-977c-50dec84437d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.400504] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('649b4534-dd4b-4426-977c-50dec84437d2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.902325] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.902592] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.902770] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.903901] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 649b4534-dd4b-4426-977c-50dec84437d2 with status ACTIVE [ 749.904145] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.904274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.904340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.904631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.904779] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.905039] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.905153] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.905221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.905775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.907412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.907412] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.907412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.907412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.907412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.907412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.907412] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 649b4534-dd4b-4426-977c-50dec84437d2 is going to be updated. [ 749.926873] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.927033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.927106] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.927320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.927464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.927617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-649b4534-dd4b-4426-977c-50dec84437d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.151180] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc in Status: SUCCESS [ 750.151471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.409142] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.914080] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.914260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.914364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.914606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.914697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.914817] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be created. [ 750.938689] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.938937] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.939029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.939254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.939455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.948506] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: UNINITIALIZED for 2s [ 751.163380] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 in Status: SUCCESS [ 751.163380] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.163380] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.163872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.164342] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.165209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.165209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.165209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.165434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.165615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.165716] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fb52e9e-114d-48d5-9b9e-c3f299243e92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.554303] env[69637]: INFO networking_nsxv3.common.synchronization [req-f4b962ed-f8a1-4796-8b51-784e1e319da4 req-296fd77c-88e5-41a7-8e97-666d529c3d64 tempest-ListServerFiltersTestJSON-297691074 tempest-ListServerFiltersTestJSON-297691074-project-member] Enqueued Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 751.556301] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 751.556654] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.556808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.556898] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.557142] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.557579] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.557692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.557762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.558229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.558329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.558443] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.668858] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fb52e9e-114d-48d5-9b9e-c3f299243e92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.061747] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.278123] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fb52e9e-114d-48d5-9b9e-c3f299243e92: rpc.has_security_group_logging(os_id): False [ 752.278123] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.278123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.278123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.278123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.278123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.278123] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.278123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.278123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.278123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.278123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.278123] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 is going to be created. [ 752.278123] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.278123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.278123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.281282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.281282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.293371] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 in Status: IN_PROGRESS for 2s [ 752.566546] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.959154] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 752.959319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.959381] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.959601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.959790] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.959901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.961031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.961031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.961031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.961031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.961031] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.074568] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.074568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.074568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.074568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.074568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.074568] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 is going to be updated. [ 753.103383] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.103383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.103383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.103383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.103383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.110767] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: IN_PROGRESS for 2s [ 753.462411] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.462674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.462726] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.462953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.463146] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.463247] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.463310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.463462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.463547] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.463637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.463783] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.463873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.463933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.464090] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.464225] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.464315] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.464375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.464518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.464605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.464688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.464779] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.856659] env[69637]: INFO networking_nsxv3.common.synchronization [req-7161d6ac-98d4-42d6-96a5-66421310b4b9 req-6d00f250-5e9b-4115-b067-2699e2c6055e tempest-ServerActionsV293TestJSON-116364786 tempest-ServerActionsV293TestJSON-116364786-project-member] Enqueued Resource ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 with Priority: HIGHEST for action security_group_members [ 753.856659] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 with Priority: HIGHEST for action security_group_members [ 753.856659] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb173e06-7b41-4fdf-ae0b-3bb378905a07 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.856659] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.856659] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.857396] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.857396] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.857396] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.857396] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.857396] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.857396] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.857396] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb173e06-7b41-4fdf-ae0b-3bb378905a07',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.970611] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f55a00f-c3f8-407e-be41-257b4c01874f: rpc.has_security_group_logging(os_id): False [ 753.987668] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.987744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.987822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.988057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.989532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.989532] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.989532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.989532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.989532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.989532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.989532] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.989532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.989532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.989532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.989532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.989532] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.989532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.989532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.990181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.990181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.990181] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be created. [ 754.009346] env[69637]: INFO networking_nsxv3.common.synchronization [None req-d5994afe-b14b-4238-b159-56f94391fd70 None None] Enqueued Resource ID: 2cec5d43-1758-4fd3-a405-0a59602a432a with Priority: HIGHEST for action port [ 754.009346] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cec5d43-1758-4fd3-a405-0a59602a432a with Priority: HIGHEST for action port [ 754.009346] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cec5d43-1758-4fd3-a405-0a59602a432a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.009346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cec5d43-1758-4fd3-a405-0a59602a432a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.009346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cec5d43-1758-4fd3-a405-0a59602a432a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.009346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cec5d43-1758-4fd3-a405-0a59602a432a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.009346] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cec5d43-1758-4fd3-a405-0a59602a432a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.050449] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.050449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.050449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.050449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.050449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.061019] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 754.305307] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 in Status: SUCCESS [ 754.305479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.360892] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.360892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.361028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.361272] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.361399] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.361713] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.361820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.361884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.362084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.362181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.362271] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 already deleted. [ 754.362365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.410638] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-549 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.410638] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-549" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.410638] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-549" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.410869] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-549" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.411159] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.411275] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.411384] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.411652] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.411798] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.412019] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.414393] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.414393] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.414393] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.414393] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.414393] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.414606] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.432654] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.432887] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 754.433072] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.433420] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-549" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.434031] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-7954231b-7251-4f7e-94ee-d97381d3a19f taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.434031] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-7954231b-7251-4f7e-94ee-d97381d3a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.434205] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-7954231b-7251-4f7e-94ee-d97381d3a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.434548] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-7954231b-7251-4f7e-94ee-d97381d3a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.434747] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7954231b-7251-4f7e-94ee-d97381d3a19f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.513275] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2cec5d43-1758-4fd3-a405-0a59602a432a [ 754.513521] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.513662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.513725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.513971] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.514177] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.514249] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2cec5d43-1758-4fd3-a405-0a59602a432a already deleted. [ 754.514334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cec5d43-1758-4fd3-a405-0a59602a432a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.938105] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.938105] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.938105] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.938105] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.938105] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.938105] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 7954231b-7251-4f7e-94ee-d97381d3a19f not found, creating... [ 754.938662] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.938662] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.938662] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.938662] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.938868] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.939291] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.939486] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.939606] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.939813] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.939946] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.940098] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 7954231b-7251-4f7e-94ee-d97381d3a19f is going to be created. [ 754.963215] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.963469] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.963593] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.963863] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.964113] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.964381] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-7954231b-7251-4f7e-94ee-d97381d3a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.134848] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: SUCCESS [ 755.135076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.931711] env[69637]: INFO networking_nsxv3.common.synchronization [req-7161d6ac-98d4-42d6-96a5-66421310b4b9 req-1635f773-bbed-4ac4-a4a3-177eb84498a7 service nova] Enqueued Resource ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 with Priority: HIGHEST for action security_group_rules [ 755.931711] env[69637]: INFO networking_nsxv3.common.synchronization [req-7161d6ac-98d4-42d6-96a5-66421310b4b9 req-1635f773-bbed-4ac4-a4a3-177eb84498a7 service nova] Enqueued Resource ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 with Priority: HIGHEST for action security_group_members [ 755.931792] env[69637]: INFO networking_nsxv3.common.synchronization [req-7161d6ac-98d4-42d6-96a5-66421310b4b9 req-1635f773-bbed-4ac4-a4a3-177eb84498a7 service nova] Enqueued Resource ID: 7954231b-7251-4f7e-94ee-d97381d3a19f with Priority: HIGHEST for action port [ 755.932688] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 with Priority: HIGHEST for action security_group_rules [ 755.932688] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 with Priority: HIGHEST for action security_group_members [ 755.932688] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7954231b-7251-4f7e-94ee-d97381d3a19f with Priority: HIGHEST for action port [ 755.932845] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb173e06-7b41-4fdf-ae0b-3bb378905a07 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.933085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.933085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.934908] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.935045] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb173e06-7b41-4fdf-ae0b-3bb378905a07',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.937269] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb173e06-7b41-4fdf-ae0b-3bb378905a07 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.937269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.937269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.937269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.937608] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.937608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.937608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.942347] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.942716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.943328] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb173e06-7b41-4fdf-ae0b-3bb378905a07',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.944480] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-7954231b-7251-4f7e-94ee-d97381d3a19f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.944637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7954231b-7251-4f7e-94ee-d97381d3a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.944907] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7954231b-7251-4f7e-94ee-d97381d3a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.944907] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7954231b-7251-4f7e-94ee-d97381d3a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.945123] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7954231b-7251-4f7e-94ee-d97381d3a19f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.072784] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 756.073019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.182303] env[69637]: INFO networking_nsxv3.common.synchronization [None req-428cb68a-1d14-4c5f-af88-2d3b13e3f1e4 None None] Enqueued Resource ID: 55d36ec5-7e11-4e41-9644-129a1cd5272e with Priority: HIGHEST for action port [ 756.184033] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55d36ec5-7e11-4e41-9644-129a1cd5272e with Priority: HIGHEST for action port [ 756.184432] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-55d36ec5-7e11-4e41-9644-129a1cd5272e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.185483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55d36ec5-7e11-4e41-9644-129a1cd5272e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.185483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55d36ec5-7e11-4e41-9644-129a1cd5272e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.185483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55d36ec5-7e11-4e41-9644-129a1cd5272e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.185483] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55d36ec5-7e11-4e41-9644-129a1cd5272e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.448591] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7954231b-7251-4f7e-94ee-d97381d3a19f with status ACTIVE [ 756.448850] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.448974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.452088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.452088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.452088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.452088] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.452088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.452088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.452088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.452088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.452088] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.452088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.452088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.452088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.452088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.452088] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7954231b-7251-4f7e-94ee-d97381d3a19f is going to be updated. [ 756.452681] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb173e06-7b41-4fdf-ae0b-3bb378905a07 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.452681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.452681] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb173e06-7b41-4fdf-ae0b-3bb378905a07',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.475223] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.475372] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.475445] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.475676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.475820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.475982] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7954231b-7251-4f7e-94ee-d97381d3a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.687182] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55d36ec5-7e11-4e41-9644-129a1cd5272e [ 756.687880] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.687880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.687880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.688202] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.688202] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.688202] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55d36ec5-7e11-4e41-9644-129a1cd5272e already deleted. [ 756.688321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55d36ec5-7e11-4e41-9644-129a1cd5272e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.954607] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb173e06-7b41-4fdf-ae0b-3bb378905a07',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.457853] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.458035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.458103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.458820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.458820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.458820] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 is going to be created. [ 757.483386] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.483525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.483595] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.483813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.485253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.494346] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 in Status: UNINITIALIZED for 2s [ 758.726396] env[69637]: INFO networking_nsxv3.common.synchronization [req-e9126d7f-dd93-4ac7-9e09-34c98d5691ad req-445b110a-8e90-463f-a5d5-428f898231ff tempest-DeleteServersAdminTestJSON-551815227 tempest-DeleteServersAdminTestJSON-551815227-project-member] Enqueued Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_members [ 758.727031] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGHEST for action security_group_members [ 758.727372] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-645e75b0-47c9-44b7-81c7-713e50cf04dc taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.727494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.727561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.727792] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.727983] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.731505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.731630] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.732578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.732578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.732578] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.234738] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.234958] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.234999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.235209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.235305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.235498] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.235631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.235697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.235852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.235930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.236040] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc is going to be updated. [ 759.276981] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.277217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.277217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.277417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.277553] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.286187] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc in Status: IN_PROGRESS for 2s [ 759.504521] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 in Status: SUCCESS [ 759.504571] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.504757] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.505504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.505504] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.505504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.505504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.505759] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.505759] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.505759] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.505931] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb173e06-7b41-4fdf-ae0b-3bb378905a07',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.008332] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb173e06-7b41-4fdf-ae0b-3bb378905a07',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.438383] env[69637]: INFO networking_nsxv3.common.synchronization [req-5a7346a3-b5ee-481a-940e-64500f9fc435 req-7bddbf97-6bfa-47a0-8e50-45efc3a4334c tempest-ServersAdminNegativeTestJSON-2061472953 tempest-ServersAdminNegativeTestJSON-2061472953-project-member] Enqueued Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_members [ 760.438939] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGHEST for action security_group_members [ 760.439292] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-552e4f46-9b42-4666-9223-428ed3c3368c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.439443] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.439563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.440444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.440655] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.440771] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.440837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.441049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.441134] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.441545] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.512409] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb173e06-7b41-4fdf-ae0b-3bb378905a07: rpc.has_security_group_logging(os_id): False [ 760.529046] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.529046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.529560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.529560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.529560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.529920] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.529920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.529920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.530156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.530156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.530221] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 is going to be created. [ 760.598764] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.598764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.598764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.598764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.598764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.609258] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 in Status: IN_PROGRESS for 2s [ 760.903402] env[69637]: INFO networking_nsxv3.common.synchronization [req-b93dbd6b-6540-42ab-bedc-272db2552d30 req-b91ea6c4-efa0-4162-b9ce-2b44fbf658f4 tempest-FloatingIPsAssociationTestJSON-1060765468 tempest-FloatingIPsAssociationTestJSON-1060765468-project-member] Enqueued Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_members [ 760.903954] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_members [ 760.904264] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fa4a6e-8adc-47da-9b8e-35f70f60c275 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.904388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.904454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.904659] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.904809] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.904897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.904976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.905132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.905218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.905308] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.945851] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.945851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.945851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.950082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.950322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.950567] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.950731] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.950835] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.951130] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.952422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.952422] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 552e4f46-9b42-4666-9223-428ed3c3368c is going to be updated. [ 760.978470] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.978918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.979048] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.979296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.979551] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.988018] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 552e4f46-9b42-4666-9223-428ed3c3368c in Status: IN_PROGRESS for 2s [ 761.237166] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-80 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.237448] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-80" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.237527] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-80" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.237741] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-80" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.237990] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.238165] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.238282] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.238494] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.238648] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.238850] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.238961] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.239167] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.239202] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.239283] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.239384] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.239511] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.261303] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.261479] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 761.261604] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.261777] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-80" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.262094] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-16edc570-a8d8-40b2-beef-41a6b84fba2f taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.262289] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-16edc570-a8d8-40b2-beef-41a6b84fba2f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.262432] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-16edc570-a8d8-40b2-beef-41a6b84fba2f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.262733] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-16edc570-a8d8-40b2-beef-41a6b84fba2f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.262874] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16edc570-a8d8-40b2-beef-41a6b84fba2f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.296136] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc in Status: SUCCESS [ 761.296726] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc deletion is rescheduled due to dependency. [ 761.296726] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.407159] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.766039] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.766039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.766039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.766039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.766412] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.766692] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 16edc570-a8d8-40b2-beef-41a6b84fba2f not found, creating... [ 761.767102] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.767425] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.767617] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.767965] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.768236] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.768616] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.768862] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.769106] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.769341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.769536] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.769722] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 16edc570-a8d8-40b2-beef-41a6b84fba2f is going to be created. [ 761.778310] env[69637]: INFO networking_nsxv3.common.synchronization [req-c432b554-d7e8-4805-aa1c-d2ffad3b5ff9 req-70e88189-9a93-409d-9160-f22aa9f7c03c tempest-ListServersNegativeTestJSON-710888184 tempest-ListServersNegativeTestJSON-710888184-project-member] Enqueued Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 761.779897] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 761.779897] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.779897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.779897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.779897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.779897] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.779897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.779897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.779897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.780248] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.781554] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.788582] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.788776] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.788900] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.789158] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.789381] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.789620] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-16edc570-a8d8-40b2-beef-41a6b84fba2f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.886152] env[69637]: INFO networking_nsxv3.common.synchronization [req-6881705b-8421-4ff7-bec6-0bc26d7b1741 req-f65048d5-411e-461b-b100-b6e4ca3cfe55 tempest-ListServersNegativeTestJSON-710888184 tempest-ListServersNegativeTestJSON-710888184-project-member] Enqueued Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 761.889705] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGHEST for action security_group_members [ 761.889705] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.889705] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.909670] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.285125] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.411384] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.411777] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.413780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.413780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.413780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.413780] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 is going to be updated. [ 762.447011] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.447011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.447011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.447011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.447011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.466775] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 in Status: IN_PROGRESS for 2s [ 762.496115] env[69637]: INFO networking_nsxv3.common.synchronization [req-b93dbd6b-6540-42ab-bedc-272db2552d30 req-d61d2088-096f-4a55-967a-f2611e05d7ac service nova] Enqueued Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_rules [ 762.496115] env[69637]: INFO networking_nsxv3.common.synchronization [req-b93dbd6b-6540-42ab-bedc-272db2552d30 req-d61d2088-096f-4a55-967a-f2611e05d7ac service nova] Enqueued Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_members [ 762.496115] env[69637]: INFO networking_nsxv3.common.synchronization [req-b93dbd6b-6540-42ab-bedc-272db2552d30 req-d61d2088-096f-4a55-967a-f2611e05d7ac service nova] Enqueued Resource ID: 16edc570-a8d8-40b2-beef-41a6b84fba2f with Priority: HIGHEST for action port [ 762.496115] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_rules [ 762.496115] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_members [ 762.496115] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16edc570-a8d8-40b2-beef-41a6b84fba2f with Priority: HIGHEST for action port [ 762.496115] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73fa4a6e-8adc-47da-9b8e-35f70f60c275 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.496115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.499592] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.499592] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.499592] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.502606] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fa4a6e-8adc-47da-9b8e-35f70f60c275 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.502606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.502606] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-16edc570-a8d8-40b2-beef-41a6b84fba2f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.502606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16edc570-a8d8-40b2-beef-41a6b84fba2f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.502606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16edc570-a8d8-40b2-beef-41a6b84fba2f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.502606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16edc570-a8d8-40b2-beef-41a6b84fba2f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.502606] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16edc570-a8d8-40b2-beef-41a6b84fba2f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.620325] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 in Status: SUCCESS [ 762.620630] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.788966] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.998936] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 552e4f46-9b42-4666-9223-428ed3c3368c in Status: SUCCESS [ 762.998936] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 552e4f46-9b42-4666-9223-428ed3c3368c deletion is rescheduled due to dependency. [ 762.998936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.001476] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fa4a6e-8adc-47da-9b8e-35f70f60c275 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.003318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.007028] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16edc570-a8d8-40b2-beef-41a6b84fba2f with status ACTIVE [ 763.007028] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.007028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.007028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.007028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.007028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.007028] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.007028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.007028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.007028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.007028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.007028] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.007028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.007028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.007028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.007028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.007028] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16edc570-a8d8-40b2-beef-41a6b84fba2f is going to be updated. [ 763.026585] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.026747] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.026851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.028021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.028021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.028021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16edc570-a8d8-40b2-beef-41a6b84fba2f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.294621] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.294992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.294992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.295187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.295361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.295531] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63016cee-78e5-471f-804a-ad9bcf1b801a is going to be updated. [ 763.328051] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.328225] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.329050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.329050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.329050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.337358] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: IN_PROGRESS for 2s [ 763.897466] env[69637]: INFO networking_nsxv3.common.synchronization [None req-82571805-fb4a-4cdc-a8dc-7898f57af72f tempest-MigrationsAdminTest-855510084 tempest-MigrationsAdminTest-855510084-project-member] Enqueued Resource ID: 72de3196-098b-495c-a033-0e1c8788a510 with Priority: HIGHEST for action security_group_rules [ 763.898035] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72de3196-098b-495c-a033-0e1c8788a510 with Priority: HIGHEST for action security_group_rules [ 763.898345] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72de3196-098b-495c-a033-0e1c8788a510 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.898468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72de3196-098b-495c-a033-0e1c8788a510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.898525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72de3196-098b-495c-a033-0e1c8788a510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.898930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72de3196-098b-495c-a033-0e1c8788a510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.898930] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72de3196-098b-495c-a033-0e1c8788a510',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.981606] env[69637]: INFO networking_nsxv3.common.synchronization [None req-af154f6f-9862-4f58-b83f-99f7ec12bb5e tempest-MigrationsAdminTest-855510084 tempest-MigrationsAdminTest-855510084-project-member] Enqueued Resource ID: 72de3196-098b-495c-a033-0e1c8788a510 with Priority: HIGHEST for action security_group_rules [ 763.982581] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72de3196-098b-495c-a033-0e1c8788a510 with Priority: HIGHEST for action security_group_rules [ 763.982932] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72de3196-098b-495c-a033-0e1c8788a510 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.983411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72de3196-098b-495c-a033-0e1c8788a510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.419029] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.419640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.419640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.419640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.419640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.420363] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72de3196-098b-495c-a033-0e1c8788a510 already deleted. [ 764.420363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72de3196-098b-495c-a033-0e1c8788a510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.420363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72de3196-098b-495c-a033-0e1c8788a510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.420363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72de3196-098b-495c-a033-0e1c8788a510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.420363] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72de3196-098b-495c-a033-0e1c8788a510',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.476075] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 in Status: SUCCESS [ 764.476334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.476500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.476737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.476920] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.477075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.477160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.477335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.477422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.477603] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.728438] env[69637]: INFO networking_nsxv3.common.synchronization [req-42dca7ed-028d-4ed2-861f-7115cb8dad1b req-e4c040c4-4b62-453c-975e-7be8727c7694 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 764.728438] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 764.728438] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.728438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.728438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.728438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.728438] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.728438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.728438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.728438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.729128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.729128] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.954572] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.954572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.954572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.954572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.954572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.954572] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72de3196-098b-495c-a033-0e1c8788a510 already deleted. [ 764.954572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72de3196-098b-495c-a033-0e1c8788a510" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.981791] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.231940] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.231940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.231940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.231940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.231940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.231940] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.231940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.231940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.231940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.232477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.232477] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be updated. [ 765.258319] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.258629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.258629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.258733] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.258872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.268720] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 765.348465] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: SUCCESS [ 765.348685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.348869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.349097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.349288] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.349377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.351025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.351025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.351025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.351025] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.483522] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.858024] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.858024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.858024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.858024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.858024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.858024] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.858024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.858024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.858024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.858024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.858024] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63016cee-78e5-471f-804a-ad9bcf1b801a is going to be updated. [ 765.881269] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.881269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.881269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.881269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.881269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.888673] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: IN_PROGRESS for 2s [ 765.990038] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.990038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.990038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.990038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.990038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.990038] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 is going to be updated. [ 766.020540] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.022877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.022877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.022877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.022877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.031021] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 in Status: IN_PROGRESS for 2s [ 766.663019] env[69637]: INFO networking_nsxv3.common.synchronization [req-54fd9beb-6dd4-4013-aada-26c88f5629ac req-7e9a2eb4-ac71-406e-83dd-25499202c576 tempest-ImagesTestJSON-1924392618 tempest-ImagesTestJSON-1924392618-project-member] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 766.663019] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 766.663955] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.664275] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.664487] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.664858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.665840] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.665840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.665840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.665840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.665840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.665840] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.007966] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.008176] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.008302] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.008601] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.008846] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.009010] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.009877] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.010242] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.010410] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.010798] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.011034] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.011185] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.011347] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.011469] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.011628] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.011840] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.034024] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.034024] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 767.034024] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.034024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.034024] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-4f4de938-df5c-4666-b2e5-bd0e17bf0e4b taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.034024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-4f4de938-df5c-4666-b2e5-bd0e17bf0e4b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.034024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-4f4de938-df5c-4666-b2e5-bd0e17bf0e4b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.034487] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-4f4de938-df5c-4666-b2e5-bd0e17bf0e4b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.034487] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f4de938-df5c-4666-b2e5-bd0e17bf0e4b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.174740] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.174740] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.174740] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.174740] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.174740] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.174740] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.174740] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.174740] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.174740] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.174740] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.174740] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 767.199086] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.199260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.199336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.199573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.199733] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.209108] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 767.277219] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 767.277479] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f deletion is rescheduled due to dependency. [ 767.277598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.537603] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.537889] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.538086] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.538373] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.538531] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.538693] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 4f4de938-df5c-4666-b2e5-bd0e17bf0e4b not found, creating... [ 767.539098] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.539286] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.539468] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.539760] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.539939] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.540336] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.540548] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.540687] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.540963] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.541183] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.541353] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 4f4de938-df5c-4666-b2e5-bd0e17bf0e4b is going to be created. [ 767.561535] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.561865] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.562017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.562358] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.563024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.563024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-4f4de938-df5c-4666-b2e5-bd0e17bf0e4b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.899653] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63016cee-78e5-471f-804a-ad9bcf1b801a in Status: SUCCESS [ 767.899943] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63016cee-78e5-471f-804a-ad9bcf1b801a deletion is rescheduled due to dependency. [ 767.900482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.043419] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 in Status: SUCCESS [ 768.043790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.044508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.044786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.045068] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.045224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.045313] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.045557] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.045710] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.045774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.045896] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.227968] env[69637]: INFO networking_nsxv3.common.synchronization [req-04cf2269-5445-4cf4-aab3-c05456c18652 req-b950a6b1-9075-4a1c-afec-58560d24f251 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 2bea8a67-35df-45be-bf57-95c80494d7fe with Priority: HIGHEST for action security_group_members [ 768.228982] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bea8a67-35df-45be-bf57-95c80494d7fe with Priority: HIGHEST for action security_group_members [ 768.229786] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bea8a67-35df-45be-bf57-95c80494d7fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.230033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.230091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.230310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.230481] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.230594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.230663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.230844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.230937] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.231052] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bea8a67-35df-45be-bf57-95c80494d7fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.293825] env[69637]: INFO networking_nsxv3.common.synchronization [req-54fd9beb-6dd4-4013-aada-26c88f5629ac req-2738f805-c63b-4e3a-9d82-51e020ca3bc2 service nova] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_rules [ 768.294041] env[69637]: INFO networking_nsxv3.common.synchronization [req-54fd9beb-6dd4-4013-aada-26c88f5629ac req-2738f805-c63b-4e3a-9d82-51e020ca3bc2 service nova] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 768.294297] env[69637]: INFO networking_nsxv3.common.synchronization [req-54fd9beb-6dd4-4013-aada-26c88f5629ac req-2738f805-c63b-4e3a-9d82-51e020ca3bc2 service nova] Enqueued Resource ID: 4f4de938-df5c-4666-b2e5-bd0e17bf0e4b with Priority: HIGHEST for action port [ 768.294923] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_rules [ 768.296448] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 768.300901] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4de938-df5c-4666-b2e5-bd0e17bf0e4b with Priority: HIGHEST for action port [ 768.300901] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.300901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.300901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.300901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.300901] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.300901] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.300901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.300901] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f4de938-df5c-4666-b2e5-bd0e17bf0e4b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.300901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f4de938-df5c-4666-b2e5-bd0e17bf0e4b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.300901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f4de938-df5c-4666-b2e5-bd0e17bf0e4b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.300901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f4de938-df5c-4666-b2e5-bd0e17bf0e4b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.300901] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f4de938-df5c-4666-b2e5-bd0e17bf0e4b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.557462] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fa4a6e-8adc-47da-9b8e-35f70f60c275 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.557679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.557751] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.558730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.559113] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.559301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.559379] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.559639] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.559752] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.559888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.560111] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fa4a6e-8adc-47da-9b8e-35f70f60c275 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.560251] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.560321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.560543] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.560716] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.560845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.560922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.561128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.561227] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.561312] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.561451] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.734588] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.734845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.734955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.735252] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.735393] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.735673] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.735803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.735912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.736119] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.736241] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.736389] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bea8a67-35df-45be-bf57-95c80494d7fe is going to be updated. [ 768.761397] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.761658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.761658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.761883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.762076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.771311] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bea8a67-35df-45be-bf57-95c80494d7fe in Status: IN_PROGRESS for 2s [ 768.803915] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.804183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.804332] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f4de938-df5c-4666-b2e5-bd0e17bf0e4b with status ACTIVE [ 768.804545] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.804691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.804781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.805054] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.805167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.805387] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.805510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.805594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.805777] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.805899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.806120] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.806242] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.806323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.806501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.806599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.806715] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f4de938-df5c-4666-b2e5-bd0e17bf0e4b is going to be updated. [ 768.827666] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.827834] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.827874] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.828084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.828222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.828390] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f4de938-df5c-4666-b2e5-bd0e17bf0e4b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.067633] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73fa4a6e-8adc-47da-9b8e-35f70f60c275: rpc.has_security_group_logging(os_id): False [ 769.087413] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.087413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.087413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.087413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.087413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.087413] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.087413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.087413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.087413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.087413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.087413] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.087413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.087413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.087413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.087413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.087912] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.087912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.087912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.087912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.087912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.087912] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 is going to be updated. [ 769.147365] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.147365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.147365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.147365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.147365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.158438] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 in Status: IN_PROGRESS for 2s [ 769.230599] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 769.230782] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 deletion is rescheduled due to dependency. [ 769.230899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.231084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.231305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.231305] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.231681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.231681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.231831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.231919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.232317] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.734429] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.118361] env[69637]: INFO networking_nsxv3.common.synchronization [req-23fe2cbb-09ee-42ea-9622-9f83e12447c7 req-d573a173-e4a6-478a-9776-b62a0aef8884 tempest-ServersTestManualDisk-188734878 tempest-ServersTestManualDisk-188734878-project-member] Enqueued Resource ID: 71aadb5f-78e6-44ce-b947-3707467a678d with Priority: HIGHEST for action security_group_members [ 770.119376] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aadb5f-78e6-44ce-b947-3707467a678d with Priority: HIGHEST for action security_group_members [ 770.119767] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aadb5f-78e6-44ce-b947-3707467a678d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.119947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.120016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.120226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.120406] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.120532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.120629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.120871] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.120990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.121126] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71aadb5f-78e6-44ce-b947-3707467a678d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.244476] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.623860] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.624053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.624261] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.624504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.624504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.624646] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.624694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.624759] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.626011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.626011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.626011] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aadb5f-78e6-44ce-b947-3707467a678d is going to be updated. [ 770.653917] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.653917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.653917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.653917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.653917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.662098] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aadb5f-78e6-44ce-b947-3707467a678d in Status: IN_PROGRESS for 2s [ 770.751069] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.751069] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.751295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.751489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.751539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.751688] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 770.778643] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.778829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.778941] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.779621] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.779819] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.782425] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bea8a67-35df-45be-bf57-95c80494d7fe in Status: SUCCESS [ 770.782641] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bea8a67-35df-45be-bf57-95c80494d7fe deletion is rescheduled due to dependency. [ 770.782769] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.790963] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 771.174489] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 in Status: SUCCESS [ 771.174735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.961673] env[69637]: INFO networking_nsxv3.common.synchronization [req-5992c902-ed5c-4bc9-a29e-33a10a2917fb req-baf6995c-78aa-4fb8-9b79-84c5ac5ef45e tempest-TenantUsagesTestJSON-509721193 tempest-TenantUsagesTestJSON-509721193-project-member] Enqueued Resource ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 with Priority: HIGHEST for action security_group_members [ 771.961673] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 with Priority: HIGHEST for action security_group_members [ 771.963276] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d67e668-2cd0-4b57-ba21-01962274ede2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.965553] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.965649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.965915] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.966109] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.966221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.966283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.966443] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.966533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.966633] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d67e668-2cd0-4b57-ba21-01962274ede2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.315034] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.315034] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.315709] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.315709] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.315709] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.315846] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.315926] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.316910] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.317160] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.317492] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 772.317773] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 772.317773] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 772.317939] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 772.318040] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 772.318842] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 772.319092] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 772.353742] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 772.353954] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 772.354083] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 772.354265] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.354605] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.355061] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.355061] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.355380] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.355464] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.470299] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.470406] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.470516] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.470703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.470793] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.470993] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.471107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.471164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.471300] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.471374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.471446] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 already deleted. [ 772.471520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.672362] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aadb5f-78e6-44ce-b947-3707467a678d in Status: SUCCESS [ 772.672362] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aadb5f-78e6-44ce-b947-3707467a678d deletion is rescheduled due to dependency. [ 772.672362] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.800893] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 772.801129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.801253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.801465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.801656] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.801768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.801839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.801992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.802088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.802172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.802264] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.858734] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.858971] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.859112] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.859473] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.859674] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.859917] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde not found, creating... [ 772.860243] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.860406] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.860522] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.860745] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.860906] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.861222] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.861375] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.861490] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.861693] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.861825] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.861987] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde is going to be created. [ 772.882284] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.882518] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.882639] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.882906] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.883903] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.883903] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.304478] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.304623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.304695] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.304912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.305089] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.305187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.305244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.305388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.305474] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.305560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.305698] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.305790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.305848] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.306161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.306274] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.306369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.306429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.306567] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.306645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.306724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.306860] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.807709] env[69637]: INFO networking_nsxv3.common.synchronization [req-5992c902-ed5c-4bc9-a29e-33a10a2917fb req-e98e0759-b35b-437e-a118-7515672da102 service nova] Enqueued Resource ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 with Priority: HIGHEST for action security_group_rules [ 773.807709] env[69637]: INFO networking_nsxv3.common.synchronization [req-5992c902-ed5c-4bc9-a29e-33a10a2917fb req-e98e0759-b35b-437e-a118-7515672da102 service nova] Enqueued Resource ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 with Priority: HIGHEST for action security_group_members [ 773.807709] env[69637]: INFO networking_nsxv3.common.synchronization [req-5992c902-ed5c-4bc9-a29e-33a10a2917fb req-e98e0759-b35b-437e-a118-7515672da102 service nova] Enqueued Resource ID: 2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde with Priority: HIGHEST for action port [ 773.807709] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 with Priority: HIGHEST for action security_group_rules [ 773.807709] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 with Priority: HIGHEST for action security_group_members [ 773.807709] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde with Priority: HIGHEST for action port [ 773.807709] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d67e668-2cd0-4b57-ba21-01962274ede2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.812229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.812229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.812229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.812229] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d67e668-2cd0-4b57-ba21-01962274ede2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.812229] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d67e668-2cd0-4b57-ba21-01962274ede2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.812229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.812229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.812229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.812229] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.812229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.812229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.812229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.812229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.812229] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d67e668-2cd0-4b57-ba21-01962274ede2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.812694] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.812820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.812902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.813087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.813161] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.814357] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc8c512a-6092-4e87-9d42-efdd0a8ab3f4: rpc.has_security_group_logging(os_id): False [ 773.832378] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.832515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.832589] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.832784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.832877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.833420] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.833420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.833420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.833420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.833575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.833653] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.833744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.833804] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.833944] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.834030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.834223] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.834315] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.834465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.834512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.834570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.834650] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 773.897383] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.897530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.897599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.897806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.897951] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.917031] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 774.315125] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d67e668-2cd0-4b57-ba21-01962274ede2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.315205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.315563] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d67e668-2cd0-4b57-ba21-01962274ede2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.317123] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde with status ACTIVE [ 774.317376] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.317529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.317619] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.317880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.318365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.318833] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.319039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.319164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.319423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.319571] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.319896] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.320148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.321089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.321089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.321089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.321089] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde is going to be updated. [ 774.341209] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.341369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.341452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.341685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.341825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.342045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f1db4c9-1cbb-4a1b-b95f-ccb9b6104dde" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.698244] env[69637]: INFO networking_nsxv3.common.synchronization [req-8103431a-70be-43d3-9329-e82c1a1dd8d2 req-2ed6e855-0d43-44cd-a887-08f2dcd1a11c tempest-ServerDiskConfigTestJSON-538739594 tempest-ServerDiskConfigTestJSON-538739594-project-member] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 774.698778] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 774.699100] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.699215] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.699429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.699484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.699625] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.699721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.699785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.699962] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.700340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.700564] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.824677] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d67e668-2cd0-4b57-ba21-01962274ede2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.202627] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.205060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.205060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.205060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.205060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.205060] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.205060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.205060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.205060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.205060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.205060] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 775.236192] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.236192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.236192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.236192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.236192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.247227] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 775.327134] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.327297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.327371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.327580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.327669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.327766] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 is going to be created. [ 775.355674] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.355674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.355674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.355674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.355674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.364873] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 in Status: UNINITIALIZED for 2s [ 775.491702] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-185 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.491937] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.492091] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.492358] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.492615] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.492759] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.492869] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.493295] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.493456] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.493660] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.493768] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.493874] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.493978] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.494095] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.494197] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.494332] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.512160] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.512313] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 775.512456] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.512620] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.512924] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-05af07b6-bfa0-473f-a854-9a84d982bdce taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.513115] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-05af07b6-bfa0-473f-a854-9a84d982bdce" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.513231] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-05af07b6-bfa0-473f-a854-9a84d982bdce" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.513521] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-05af07b6-bfa0-473f-a854-9a84d982bdce" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.514266] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05af07b6-bfa0-473f-a854-9a84d982bdce',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.933365] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 775.933824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.990849] env[69637]: INFO networking_nsxv3.common.synchronization [None req-58d5f8da-8269-4e20-b28a-235764a9151f None None] Enqueued Resource ID: 7ff2fa86-9961-4a68-aa07-7e8082cdd82a with Priority: HIGHEST for action port [ 775.990849] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff2fa86-9961-4a68-aa07-7e8082cdd82a with Priority: HIGHEST for action port [ 775.991308] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ff2fa86-9961-4a68-aa07-7e8082cdd82a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.991449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ff2fa86-9961-4a68-aa07-7e8082cdd82a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.991502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ff2fa86-9961-4a68-aa07-7e8082cdd82a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.991841] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ff2fa86-9961-4a68-aa07-7e8082cdd82a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.991940] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ff2fa86-9961-4a68-aa07-7e8082cdd82a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.016770] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.017023] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.017150] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.017519] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.017689] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.017882] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 05af07b6-bfa0-473f-a854-9a84d982bdce not found, creating... [ 776.018206] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.018405] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.019334] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.019334] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.019334] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.019585] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.019725] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.020209] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.020517] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.020702] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.020877] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 05af07b6-bfa0-473f-a854-9a84d982bdce is going to be created. [ 776.041350] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.041883] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.041883] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.042028] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.042312] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.042555] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-05af07b6-bfa0-473f-a854-9a84d982bdce" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.497765] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ff2fa86-9961-4a68-aa07-7e8082cdd82a [ 776.497765] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.497935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.497935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.499107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.499107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.499107] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ff2fa86-9961-4a68-aa07-7e8082cdd82a already deleted. [ 776.499107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ff2fa86-9961-4a68-aa07-7e8082cdd82a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.847882] env[69637]: INFO networking_nsxv3.common.synchronization [req-8103431a-70be-43d3-9329-e82c1a1dd8d2 req-5b741319-8f6b-4043-b5ea-69cda3922541 service nova] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_rules [ 776.848083] env[69637]: INFO networking_nsxv3.common.synchronization [req-8103431a-70be-43d3-9329-e82c1a1dd8d2 req-5b741319-8f6b-4043-b5ea-69cda3922541 service nova] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 776.849309] env[69637]: INFO networking_nsxv3.common.synchronization [req-8103431a-70be-43d3-9329-e82c1a1dd8d2 req-5b741319-8f6b-4043-b5ea-69cda3922541 service nova] Enqueued Resource ID: 05af07b6-bfa0-473f-a854-9a84d982bdce with Priority: HIGHEST for action port [ 776.849309] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_rules [ 776.849309] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 776.849309] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05af07b6-bfa0-473f-a854-9a84d982bdce with Priority: HIGHEST for action port [ 776.849457] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.849554] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.849619] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.850133] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.850133] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.850907] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.851230] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.851230] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-05af07b6-bfa0-473f-a854-9a84d982bdce taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.851440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05af07b6-bfa0-473f-a854-9a84d982bdce" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.851440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05af07b6-bfa0-473f-a854-9a84d982bdce" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.851649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05af07b6-bfa0-473f-a854-9a84d982bdce" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.851748] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05af07b6-bfa0-473f-a854-9a84d982bdce',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.239296] env[69637]: INFO networking_nsxv3.common.synchronization [req-813f9d39-4d81-4784-8d8b-008663811680 req-86838af9-ee61-4c15-938d-e94c41a7058f tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 777.239296] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 777.239296] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.239296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.239296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.239296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.239296] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.239296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.239296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.239296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.239296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.239296] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.259391] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 777.259582] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac deletion is rescheduled due to dependency. [ 777.259684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.260588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.260657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.260888] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.261041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.261117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.261262] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.262279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.262279] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.321658] env[69637]: INFO networking_nsxv3.common.synchronization [req-286626df-9793-4e72-bb5e-27f59839f862 req-1c762ade-e4e3-4c3b-b42d-b762edda12ad tempest-SecurityGroupRulesNegativeTestJSON-1299040619 tempest-SecurityGroupRulesNegativeTestJSON-1299040619-project-member] Enqueued Resource ID: db9556ee-8b72-49a4-9c4e-979c470c5ced with Priority: HIGHEST for action security_group_rules [ 777.322250] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9556ee-8b72-49a4-9c4e-979c470c5ced with Priority: HIGHEST for action security_group_rules [ 777.322548] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db9556ee-8b72-49a4-9c4e-979c470c5ced taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.322694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db9556ee-8b72-49a4-9c4e-979c470c5ced" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.322773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db9556ee-8b72-49a4-9c4e-979c470c5ced" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.323066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db9556ee-8b72-49a4-9c4e-979c470c5ced" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.323166] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db9556ee-8b72-49a4-9c4e-979c470c5ced',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.356259] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.356259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.356259] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05af07b6-bfa0-473f-a854-9a84d982bdce with status ACTIVE [ 777.356259] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.356259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.356259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.356259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.356259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.356259] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.356259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.356259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.356259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.356259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.356259] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.356783] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.356783] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.356783] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.356783] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.356783] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05af07b6-bfa0-473f-a854-9a84d982bdce is going to be updated. [ 777.373650] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 in Status: SUCCESS [ 777.373791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.374109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.374376] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.374699] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.374773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.374823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.374961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.375215] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.375330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.375433] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d67e668-2cd0-4b57-ba21-01962274ede2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.378150] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.378284] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.378354] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.378994] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.379211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.379299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05af07b6-bfa0-473f-a854-9a84d982bdce" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.746589] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.747099] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.748267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.748590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.748734] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.750596] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.750596] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.750596] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.750596] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.750596] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.750596] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a already deleted. [ 777.750596] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.766523] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.837497] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-682 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.837777] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-682" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.837906] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-682" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.838288] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-682" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.838583] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.838788] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.838925] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.839258] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.839413] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.839654] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.839822] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.840050] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.840215] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.840305] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.840413] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.840561] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.846454] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.846454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.846559] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.846810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.846810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.846960] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db9556ee-8b72-49a4-9c4e-979c470c5ced already deleted. [ 777.846960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db9556ee-8b72-49a4-9c4e-979c470c5ced" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.863340] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.863537] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 777.863685] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.863840] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-682" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.864129] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.864325] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.864540] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.864750] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.864890] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('679d8b04-b3bc-4b2e-a923-c0dd535c1a10',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.880953] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d67e668-2cd0-4b57-ba21-01962274ede2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.881273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.881273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.883578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.883889] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.884044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.884232] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.884404] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.884513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.884621] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.884956] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d67e668-2cd0-4b57-ba21-01962274ede2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.884956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.886081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.886081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.886081] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.886081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.886081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.886081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.886081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.886081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.886081] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d67e668-2cd0-4b57-ba21-01962274ede2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.270135] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.367462] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.367758] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.368332] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.368453] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.368831] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.368831] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 679d8b04-b3bc-4b2e-a923-c0dd535c1a10 not found, creating... [ 778.369025] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.369183] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.369480] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.369543] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.369710] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.370375] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.370543] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.370729] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.371012] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.371184] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.371399] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 679d8b04-b3bc-4b2e-a923-c0dd535c1a10 is going to be created. [ 778.390273] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.390492] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.390639] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.390922] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.391167] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.391391] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.392551] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d67e668-2cd0-4b57-ba21-01962274ede2: rpc.has_security_group_logging(os_id): False [ 778.409225] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.409225] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.409225] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.409515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.409576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.409758] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.409937] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.410036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.410194] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.410807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.410807] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.410807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.410807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.410807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.410807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.411225] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.411225] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.411225] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.411410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.411410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.411502] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 is going to be created. [ 778.470494] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.470494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.470494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.470494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.470494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.483656] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 in Status: IN_PROGRESS for 2s [ 778.751578] env[69637]: INFO networking_nsxv3.common.synchronization [None req-c43c7003-e647-4db3-9bc1-8619b4447541 None None] Enqueued Resource ID: e0653489-fc39-46f4-be92-10b2230de966 with Priority: HIGHEST for action port [ 778.751578] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0653489-fc39-46f4-be92-10b2230de966 with Priority: HIGHEST for action port [ 778.751578] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0653489-fc39-46f4-be92-10b2230de966 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.751578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0653489-fc39-46f4-be92-10b2230de966" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.751578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0653489-fc39-46f4-be92-10b2230de966" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.751578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0653489-fc39-46f4-be92-10b2230de966" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.751578] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0653489-fc39-46f4-be92-10b2230de966',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.772191] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.777714] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.777714] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.777714] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.777714] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.777714] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 778.788556] env[69637]: INFO networking_nsxv3.common.synchronization [req-8f8f400d-d9e2-450b-a9fd-f9f9b6c564fc req-e82a2aa4-1b86-47a8-bc0b-7504faf8d23c tempest-SecurityGroupRulesNegativeTestJSON-1299040619 tempest-SecurityGroupRulesNegativeTestJSON-1299040619-project-member] Enqueued Resource ID: db9556ee-8b72-49a4-9c4e-979c470c5ced with Priority: HIGHEST for action security_group_rules [ 778.789928] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9556ee-8b72-49a4-9c4e-979c470c5ced with Priority: HIGHEST for action security_group_rules [ 778.789928] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db9556ee-8b72-49a4-9c4e-979c470c5ced taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.789928] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db9556ee-8b72-49a4-9c4e-979c470c5ced" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.789928] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db9556ee-8b72-49a4-9c4e-979c470c5ced" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.789928] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db9556ee-8b72-49a4-9c4e-979c470c5ced" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.789928] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db9556ee-8b72-49a4-9c4e-979c470c5ced',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.804010] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.804160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.804236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.804708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.804872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.817871] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 779.017856] env[69637]: INFO networking_nsxv3.common.synchronization [req-89273a55-5b9f-4087-a36b-fb05f01f792b req-ebc9ec38-6b6b-4a93-a94a-a88aa91da755 tempest-FloatingIPsAssociationTestJSON-1060765468 tempest-FloatingIPsAssociationTestJSON-1060765468-project-member] Enqueued Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_members [ 779.019026] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_members [ 779.022497] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fa4a6e-8adc-47da-9b8e-35f70f60c275 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.022744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.023282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.023613] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.024372] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.025186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.026364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.026609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.026716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.026841] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.124573] env[69637]: INFO networking_nsxv3.common.synchronization [req-813f9d39-4d81-4784-8d8b-008663811680 req-9ebc1bce-8e8d-4290-8242-dcb34e67f39e service nova] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_rules [ 779.127238] env[69637]: INFO networking_nsxv3.common.synchronization [req-813f9d39-4d81-4784-8d8b-008663811680 req-9ebc1bce-8e8d-4290-8242-dcb34e67f39e service nova] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 779.127695] env[69637]: INFO networking_nsxv3.common.synchronization [req-813f9d39-4d81-4784-8d8b-008663811680 req-9ebc1bce-8e8d-4290-8242-dcb34e67f39e service nova] Enqueued Resource ID: 679d8b04-b3bc-4b2e-a923-c0dd535c1a10 with Priority: HIGHEST for action port [ 779.128493] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_rules [ 779.129264] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 779.129264] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 679d8b04-b3bc-4b2e-a923-c0dd535c1a10 with Priority: HIGHEST for action port [ 779.129264] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.129824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.130260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.131178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.131178] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.133160] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.133340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.133447] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.133887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.133949] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.134405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.134405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.134405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.134405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.134612] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.135549] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.135662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.135824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.135975] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.136085] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('679d8b04-b3bc-4b2e-a923-c0dd535c1a10',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.256519] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0653489-fc39-46f4-be92-10b2230de966 [ 779.256855] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.257069] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.257195] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.257546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.257622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.257770] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0653489-fc39-46f4-be92-10b2230de966 already deleted. [ 779.257897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0653489-fc39-46f4-be92-10b2230de966" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.311132] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.311132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.311132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.311132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.311132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.311604] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db9556ee-8b72-49a4-9c4e-979c470c5ced already deleted. [ 779.311604] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db9556ee-8b72-49a4-9c4e-979c470c5ced" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.529375] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.637814] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.641529] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.641923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.642476] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 679d8b04-b3bc-4b2e-a923-c0dd535c1a10 with status ACTIVE [ 779.642993] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.643239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.643398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.643905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.644106] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.645312] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.645938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.646139] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.646404] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.646573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.646846] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.647460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.647617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.647860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.648215] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.648425] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 679d8b04-b3bc-4b2e-a923-c0dd535c1a10 is going to be updated. [ 779.668543] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.668742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.668888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.669222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.669439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.669679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.032884] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.144786] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.199224] env[69637]: INFO networking_nsxv3.common.synchronization [req-455860f7-723d-4830-8d38-fec91613e519 req-be2304ba-9072-4b4b-aa23-b58f6257fead tempest-MultipleCreateTestJSON-1546211828 tempest-MultipleCreateTestJSON-1546211828-project-member] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 780.199826] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 780.200185] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.200356] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.200431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.200625] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.200778] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.200864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.201214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.202644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.203048] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.203048] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.499672] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 in Status: SUCCESS [ 780.499672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.535602] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.535960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.536208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.539834] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.539834] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.539834] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 is going to be updated. [ 780.564256] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.564453] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.564539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.564775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.564946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.574342] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 in Status: IN_PROGRESS for 2s [ 780.646444] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.648395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.648395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.648395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.648395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.648395] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be created. [ 780.671080] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.671464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.671535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.671778] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.671939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.681899] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: UNINITIALIZED for 2s [ 780.706230] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.706340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.706340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.706596] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.707099] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.707099] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.708099] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.708199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.708403] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.708492] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.708604] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab904195-351a-49c6-8462-7f952d95cf87 already deleted. [ 780.708696] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.826625] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 780.826752] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.826868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.827211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.827429] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.827665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.827665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.827798] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.827861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.828205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.828205] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.864680] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.864882] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.864978] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.865300] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.865552] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.865702] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.865870] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.866112] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.866252] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.866454] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.866560] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.866663] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.866998] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.867124] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.867230] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.868149] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.888112] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.888300] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 780.888437] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.888621] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.888948] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-980d3237-53d1-48e2-b049-d05b23bef245 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.889153] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-980d3237-53d1-48e2-b049-d05b23bef245" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.889312] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-980d3237-53d1-48e2-b049-d05b23bef245" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.889635] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-980d3237-53d1-48e2-b049-d05b23bef245" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.889779] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('980d3237-53d1-48e2-b049-d05b23bef245',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.331864] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.332251] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.332251] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.332407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.332506] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.332607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.332671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.332857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.333075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.333075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.333297] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.333423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.333490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.333620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.333775] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.333888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.333964] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.334059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.334268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.334380] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.334470] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.394543] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.394884] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.395118] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.395526] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.395765] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.396018] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 980d3237-53d1-48e2-b049-d05b23bef245 not found, creating... [ 781.396436] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.396683] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.396909] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.402425] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.402678] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.403185] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.403445] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.403641] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.403980] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.404225] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.404461] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 980d3237-53d1-48e2-b049-d05b23bef245 is going to be created. [ 781.434967] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.435240] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.435377] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.435665] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.435918] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.436165] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-980d3237-53d1-48e2-b049-d05b23bef245" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.836832] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bac27816-ae12-436b-86da-6c4bbde7b2ac: rpc.has_security_group_logging(os_id): False [ 781.859368] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.859535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.859619] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.859846] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.859939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.860166] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.860723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.860843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.861063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.861233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.861440] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.861661] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.861661] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.861850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.861967] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.862250] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.862418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.862513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.862691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.862853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.863020] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 781.925794] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.925895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.925997] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.926286] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.926472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.941497] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 782.095224] env[69637]: INFO networking_nsxv3.common.synchronization [req-bca3b925-3f08-4dda-a62e-159ee7c23c1e req-dd1eb7d7-b199-4b6f-852f-eda439fa1d79 tempest-ServersV294TestFqdnHostnames-986425398 tempest-ServersV294TestFqdnHostnames-986425398-project-member] Enqueued Resource ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 with Priority: HIGHEST for action security_group_members [ 782.095727] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 with Priority: HIGHEST for action security_group_members [ 782.096051] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2bf78cc-b175-4724-9f7a-27b142d3a998 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.096171] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.096235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.096428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.096576] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.096802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.097963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.097963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.097963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.097963] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2bf78cc-b175-4724-9f7a-27b142d3a998',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.133667] env[69637]: INFO networking_nsxv3.common.synchronization [req-455860f7-723d-4830-8d38-fec91613e519 req-dbf8c84b-f4de-401a-a95f-dedbe8cb5a39 service nova] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_rules [ 782.133859] env[69637]: INFO networking_nsxv3.common.synchronization [req-455860f7-723d-4830-8d38-fec91613e519 req-dbf8c84b-f4de-401a-a95f-dedbe8cb5a39 service nova] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 782.133980] env[69637]: INFO networking_nsxv3.common.synchronization [req-455860f7-723d-4830-8d38-fec91613e519 req-dbf8c84b-f4de-401a-a95f-dedbe8cb5a39 service nova] Enqueued Resource ID: 980d3237-53d1-48e2-b049-d05b23bef245 with Priority: HIGHEST for action port [ 782.134219] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_rules [ 782.134360] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 782.134459] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 980d3237-53d1-48e2-b049-d05b23bef245 with Priority: HIGHEST for action port [ 782.134949] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.135949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.136082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.136379] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.137240] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.137775] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.138021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.138021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.139331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.139331] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.139331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.139510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.142047] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.142047] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.142047] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.142047] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-980d3237-53d1-48e2-b049-d05b23bef245 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.142047] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-980d3237-53d1-48e2-b049-d05b23bef245" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.142047] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-980d3237-53d1-48e2-b049-d05b23bef245" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.142047] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-980d3237-53d1-48e2-b049-d05b23bef245" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.143031] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('980d3237-53d1-48e2-b049-d05b23bef245',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.587623] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 in Status: SUCCESS [ 782.587865] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.602860] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.602860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.602860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.603120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.603120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.603347] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.603456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.603520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.603686] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.603785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.603882] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 is going to be updated. [ 782.627226] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.627392] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.627478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.627722] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.627877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.635886] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 in Status: IN_PROGRESS for 2s [ 782.650589] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.651800] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.652123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.654362] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 980d3237-53d1-48e2-b049-d05b23bef245 with status ACTIVE [ 782.656571] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.658725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.658725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.658725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.658725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.658725] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.658725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.658725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.658725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.658725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.658725] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.659745] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.659915] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.660325] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.661938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.661938] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 980d3237-53d1-48e2-b049-d05b23bef245 is going to be updated. [ 782.684021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.684021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.684021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.684021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.684021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.684021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-980d3237-53d1-48e2-b049-d05b23bef245" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.693484] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 782.693681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.693859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.694109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.694292] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.694405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.694467] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.694634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.694688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.694823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.694860] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.152791] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.198131] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.198131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.198131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.198131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.198131] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.198131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.198131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.198131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.198443] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.198443] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.198443] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.198546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.198578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.198726] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.198820] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.198904] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.198958] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.199114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.199198] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.199281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.200049] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.655481] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.655660] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.655768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.655949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.656062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.656169] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be created. [ 783.676963] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.677343] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.677469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.677692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.677878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.686699] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: UNINITIALIZED for 2s [ 783.703236] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1db16c79-2ca0-4113-99b1-64acc68fd18a: rpc.has_security_group_logging(os_id): False [ 783.718840] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.718980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.719073] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.719414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.719514] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.719738] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.719844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.719906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.720104] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.720187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.720349] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.720452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.720525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.720672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.720782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.720996] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.721111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.721190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.721336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.721425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.721497] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be created. [ 783.775765] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.776044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.776044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.777047] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.777263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.789426] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 783.952504] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 783.952735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.646337] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 in Status: SUCCESS [ 784.647195] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 deletion is rescheduled due to dependency. [ 784.647195] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.391812] env[69637]: INFO networking_nsxv3.common.synchronization [req-455860f7-723d-4830-8d38-fec91613e519 req-cbf2a976-661a-4505-960d-54d828e6c534 tempest-MultipleCreateTestJSON-1546211828 tempest-MultipleCreateTestJSON-1546211828-project-member] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 785.392585] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 785.392735] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.392840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.453804] env[69637]: INFO networking_nsxv3.common.synchronization [req-ac69001d-dc42-404c-abf6-9c7872b409f2 req-e87ee249-75f3-41b9-ba23-8df1675be56b tempest-ListServerFiltersTestJSON-297691074 tempest-ListServerFiltersTestJSON-297691074-project-member] Enqueued Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 785.454492] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 785.454930] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.455399] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.455581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.457057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.457057] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.457057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.457057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.457057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.457057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.457057] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.698833] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: SUCCESS [ 785.699130] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.699219] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.699486] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.699613] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.699730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.699790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.699937] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.704123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.704201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.704627] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.705288] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.705413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.705536] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.705645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.705707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.705851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.705930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.706029] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.788580] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.788825] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.788994] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.789341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.789605] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.789757] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.789894] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.790341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.790341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.790570] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 785.790686] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.790795] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.790901] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.791031] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 785.791135] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.791287] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.804523] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 785.804780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.810441] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.810608] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 785.810762] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.810941] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.811268] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-fd54762f-41cc-4b85-ae1b-7ee25be29116 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.811459] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-fd54762f-41cc-4b85-ae1b-7ee25be29116" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.811590] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-fd54762f-41cc-4b85-ae1b-7ee25be29116" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.811894] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-fd54762f-41cc-4b85-ae1b-7ee25be29116" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.812059] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd54762f-41cc-4b85-ae1b-7ee25be29116',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.958760] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.208724] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.209389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.209721] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.236597] env[69637]: INFO networking_nsxv3.common.synchronization [req-7fbb3e96-9479-472d-95c8-680c4dff85a8 req-46f187b8-21b5-45a5-9e54-afc70e4708a8 tempest-TenantUsagesTestJSON-509721193 tempest-TenantUsagesTestJSON-509721193-project-member] Enqueued Resource ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 with Priority: HIGHEST for action security_group_members [ 786.236597] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 with Priority: HIGHEST for action security_group_members [ 786.236597] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d67e668-2cd0-4b57-ba21-01962274ede2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.236597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.236597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.236597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.236597] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.236597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.236597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.237534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.237835] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.238041] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d67e668-2cd0-4b57-ba21-01962274ede2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.314893] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.315039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.315829] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.315829] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.315829] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.315829] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port fd54762f-41cc-4b85-ae1b-7ee25be29116 not found, creating... [ 786.316058] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.316233] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.316352] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.316575] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.316705] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.318355] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.318608] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.318674] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.318891] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.319057] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.319190] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: fd54762f-41cc-4b85-ae1b-7ee25be29116 is going to be created. [ 786.357802] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.358066] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.358180] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.358462] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.358690] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.359126] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-fd54762f-41cc-4b85-ae1b-7ee25be29116" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.461807] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.712626] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.740353] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.740539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.740539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.741899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.741899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.741899] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.741899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.741899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.741899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.741899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.741899] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 is going to be updated. [ 786.767839] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.768114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.768219] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.768479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.768882] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.780501] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 in Status: IN_PROGRESS for 2s [ 786.964213] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.964405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.964583] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.964668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.964757] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.964854] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 is going to be updated. [ 786.995288] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.996296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.996427] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.997041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.997230] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.005738] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: IN_PROGRESS for 2s [ 787.093095] env[69637]: INFO networking_nsxv3.common.synchronization [req-455860f7-723d-4830-8d38-fec91613e519 req-e99dba7a-f4a0-4a0c-ab7e-1f378688e8fb service nova] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_rules [ 787.093195] env[69637]: INFO networking_nsxv3.common.synchronization [req-455860f7-723d-4830-8d38-fec91613e519 req-e99dba7a-f4a0-4a0c-ab7e-1f378688e8fb service nova] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 787.093338] env[69637]: INFO networking_nsxv3.common.synchronization [req-455860f7-723d-4830-8d38-fec91613e519 req-e99dba7a-f4a0-4a0c-ab7e-1f378688e8fb service nova] Enqueued Resource ID: fd54762f-41cc-4b85-ae1b-7ee25be29116 with Priority: HIGHEST for action port [ 787.093608] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_rules [ 787.093741] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 787.093848] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd54762f-41cc-4b85-ae1b-7ee25be29116 with Priority: HIGHEST for action port [ 787.098719] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.098884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.099136] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.099260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.099391] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd54762f-41cc-4b85-ae1b-7ee25be29116 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.099507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd54762f-41cc-4b85-ae1b-7ee25be29116" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.099574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd54762f-41cc-4b85-ae1b-7ee25be29116" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.099762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd54762f-41cc-4b85-ae1b-7ee25be29116" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.099867] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd54762f-41cc-4b85-ae1b-7ee25be29116',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.216784] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.216784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.216784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.216784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.216784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.216784] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be updated. [ 787.257233] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.257400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.257461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.257662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.257810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.268473] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: IN_PROGRESS for 2s [ 787.606725] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd54762f-41cc-4b85-ae1b-7ee25be29116 with status ACTIVE [ 787.606942] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.607135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.607207] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.607430] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.607522] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.607731] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.607828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.607890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.608051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.608130] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.608309] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.608413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.608451] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.608583] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.608656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.608748] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd54762f-41cc-4b85-ae1b-7ee25be29116 is going to be updated. [ 787.628839] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.628994] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.629118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.629378] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.629546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.629768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd54762f-41cc-4b85-ae1b-7ee25be29116" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.790299] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 in Status: SUCCESS [ 788.790646] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 deletion is rescheduled due to dependency. [ 788.790646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.016688] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: SUCCESS [ 789.016933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.277994] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: SUCCESS [ 789.278251] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.278438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.278661] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.279061] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.279222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.279294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.279452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.279535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.279625] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.279787] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.279867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.279925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.280118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.280275] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.280329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.280374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.280768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.280768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.280768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.280940] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.281746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.282563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.282725] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.283373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.283373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.283373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.283373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.283373] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.687902] env[69637]: INFO networking_nsxv3.common.synchronization [req-a80e71eb-490e-4d49-82e9-8726985d2605 req-5202daeb-5665-404d-a5b5-5acaaa059e62 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 789.688355] env[69637]: INFO networking_nsxv3.common.synchronization [req-a80e71eb-490e-4d49-82e9-8726985d2605 req-5202daeb-5665-404d-a5b5-5acaaa059e62 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGHEST for action security_group_members [ 789.689122] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 789.689122] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGHEST for action security_group_members [ 789.689122] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.689304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.689304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.689395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.689543] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.689635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.689694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.690526] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.690526] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.690526] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.691371] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad77a84e-935d-4f36-9c82-e497b2b9c639 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.691371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.691371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.691545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.691545] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.691705] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.691705] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.691943] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.691999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.692233] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.745483] env[69637]: INFO networking_nsxv3.common.synchronization [req-a80e71eb-490e-4d49-82e9-8726985d2605 req-5202daeb-5665-404d-a5b5-5acaaa059e62 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_rules [ 789.745483] env[69637]: INFO networking_nsxv3.common.synchronization [req-a80e71eb-490e-4d49-82e9-8726985d2605 req-5202daeb-5665-404d-a5b5-5acaaa059e62 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 789.745483] env[69637]: INFO networking_nsxv3.common.synchronization [req-a80e71eb-490e-4d49-82e9-8726985d2605 req-5202daeb-5665-404d-a5b5-5acaaa059e62 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGHEST for action security_group_rules [ 789.745483] env[69637]: INFO networking_nsxv3.common.synchronization [req-a80e71eb-490e-4d49-82e9-8726985d2605 req-5202daeb-5665-404d-a5b5-5acaaa059e62 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGHEST for action security_group_members [ 789.745483] env[69637]: INFO networking_nsxv3.common.synchronization [req-a80e71eb-490e-4d49-82e9-8726985d2605 req-5202daeb-5665-404d-a5b5-5acaaa059e62 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 679d8b04-b3bc-4b2e-a923-c0dd535c1a10 with Priority: HIGHEST for action port [ 789.746065] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_rules [ 789.748868] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGHEST for action security_group_rules [ 789.749068] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 679d8b04-b3bc-4b2e-a923-c0dd535c1a10 with Priority: HIGHEST for action port [ 789.749209] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 789.749335] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGHEST for action security_group_members [ 789.753040] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.753040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.753040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.753040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.753040] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.753040] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad77a84e-935d-4f36-9c82-e497b2b9c639 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.753040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.753040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.753040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.753040] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.753469] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.753469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.753542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.753788] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.753885] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('679d8b04-b3bc-4b2e-a923-c0dd535c1a10',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.754701] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.754901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.755167] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad77a84e-935d-4f36-9c82-e497b2b9c639 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.755250] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.785449] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab904195-351a-49c6-8462-7f952d95cf87: rpc.has_security_group_logging(os_id): False [ 789.786623] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.806097] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.807496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.807496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.807496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.807496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.807496] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.807496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.807496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.807496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.807496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.807966] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.809412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.809412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.809412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.809412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.809412] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.809412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.809412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.809786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.809786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.809786] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be created. [ 789.871325] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.871461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.871536] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.871785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.871926] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.884103] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: IN_PROGRESS for 2s [ 790.194630] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.195444] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.257090] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.257259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.257535] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad77a84e-935d-4f36-9c82-e497b2b9c639 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.257623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.257780] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 679d8b04-b3bc-4b2e-a923-c0dd535c1a10 with status ACTIVE [ 790.257948] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.258079] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.258147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.258351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.258440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.260652] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.260652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.260652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.260652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.260652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.260652] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.260652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.260652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.260652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.260652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.260652] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 679d8b04-b3bc-4b2e-a923-c0dd535c1a10 is going to be updated. [ 790.281437] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.281437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.281437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.281437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.281437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.281437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.289038] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.510898] env[69637]: INFO networking_nsxv3.common.synchronization [req-b2532a8e-1f7b-483a-8cde-9e07abc81bcf req-cdb16a1f-99a4-4eca-9986-9022aac3e6f3 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: fefafe98-8990-454a-a252-19be0a2a5042 with Priority: HIGHEST for action security_group_members [ 790.511148] env[69637]: INFO networking_nsxv3.common.synchronization [req-b2532a8e-1f7b-483a-8cde-9e07abc81bcf req-cdb16a1f-99a4-4eca-9986-9022aac3e6f3 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 790.511333] env[69637]: INFO networking_nsxv3.common.synchronization [req-b2532a8e-1f7b-483a-8cde-9e07abc81bcf req-cdb16a1f-99a4-4eca-9986-9022aac3e6f3 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGHEST for action security_group_members [ 790.514475] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefafe98-8990-454a-a252-19be0a2a5042 with Priority: HIGHEST for action security_group_members [ 790.514655] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 790.514767] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGHEST for action security_group_members [ 790.515086] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefafe98-8990-454a-a252-19be0a2a5042 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.515225] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.515295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.515539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.515708] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.515809] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.515872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.516039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.516122] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.516216] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefafe98-8990-454a-a252-19be0a2a5042',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.517072] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.521330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.521552] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad77a84e-935d-4f36-9c82-e497b2b9c639 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.521644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.569936] env[69637]: INFO networking_nsxv3.common.synchronization [req-b2532a8e-1f7b-483a-8cde-9e07abc81bcf req-cdb16a1f-99a4-4eca-9986-9022aac3e6f3 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_rules [ 790.570151] env[69637]: INFO networking_nsxv3.common.synchronization [req-b2532a8e-1f7b-483a-8cde-9e07abc81bcf req-cdb16a1f-99a4-4eca-9986-9022aac3e6f3 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 790.570287] env[69637]: INFO networking_nsxv3.common.synchronization [req-b2532a8e-1f7b-483a-8cde-9e07abc81bcf req-cdb16a1f-99a4-4eca-9986-9022aac3e6f3 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGHEST for action security_group_rules [ 790.570417] env[69637]: INFO networking_nsxv3.common.synchronization [req-b2532a8e-1f7b-483a-8cde-9e07abc81bcf req-cdb16a1f-99a4-4eca-9986-9022aac3e6f3 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGHEST for action security_group_members [ 790.570542] env[69637]: INFO networking_nsxv3.common.synchronization [req-b2532a8e-1f7b-483a-8cde-9e07abc81bcf req-cdb16a1f-99a4-4eca-9986-9022aac3e6f3 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: fefafe98-8990-454a-a252-19be0a2a5042 with Priority: HIGHEST for action security_group_rules [ 790.570668] env[69637]: INFO networking_nsxv3.common.synchronization [req-b2532a8e-1f7b-483a-8cde-9e07abc81bcf req-cdb16a1f-99a4-4eca-9986-9022aac3e6f3 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: fefafe98-8990-454a-a252-19be0a2a5042 with Priority: HIGHEST for action security_group_members [ 790.570786] env[69637]: INFO networking_nsxv3.common.synchronization [req-b2532a8e-1f7b-483a-8cde-9e07abc81bcf req-cdb16a1f-99a4-4eca-9986-9022aac3e6f3 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 679d8b04-b3bc-4b2e-a923-c0dd535c1a10 with Priority: HIGHEST for action port [ 790.571527] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_rules [ 790.571727] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGHEST for action security_group_rules [ 790.571882] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefafe98-8990-454a-a252-19be0a2a5042 with Priority: HIGHEST for action security_group_members [ 790.572090] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 679d8b04-b3bc-4b2e-a923-c0dd535c1a10 with Priority: HIGHEST for action port [ 790.572262] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefafe98-8990-454a-a252-19be0a2a5042 with Priority: HIGHEST for action security_group_rules [ 790.572416] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 790.572586] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGHEST for action security_group_members [ 790.572945] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.573105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.573352] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad77a84e-935d-4f36-9c82-e497b2b9c639 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.573483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.573702] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefafe98-8990-454a-a252-19be0a2a5042 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.573838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.574072] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.574228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.574331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.574575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.574709] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('679d8b04-b3bc-4b2e-a923-c0dd535c1a10',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.575658] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fefafe98-8990-454a-a252-19be0a2a5042 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.575767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.575872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.576157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.576286] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fefafe98-8990-454a-a252-19be0a2a5042',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.581021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.581021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.581021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad77a84e-935d-4f36-9c82-e497b2b9c639 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.581021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.697719] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.699215] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.791049] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.794452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.794565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.794785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.794884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.794996] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be updated. [ 790.828319] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.828319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.828319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.828319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.828319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.837079] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: IN_PROGRESS for 2s [ 791.023072] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fefafe98-8990-454a-a252-19be0a2a5042',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.083097] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefafe98-8990-454a-a252-19be0a2a5042 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.083263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.083568] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 679d8b04-b3bc-4b2e-a923-c0dd535c1a10 with status ACTIVE [ 791.083824] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.084058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.084160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.084448] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.084639] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.084904] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.085093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.085208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.085487] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.085620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.085932] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.086100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.086193] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.086430] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.086537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.086653] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 679d8b04-b3bc-4b2e-a923-c0dd535c1a10 is going to be updated. [ 791.109098] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.109270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.109270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.109499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.109642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.109820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-679d8b04-b3bc-4b2e-a923-c0dd535c1a10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.200368] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.200684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.200684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.200877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.200982] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.201101] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 791.202585] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.202785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.202896] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.203187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.203373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.203462] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 is going to be created. [ 791.259957] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.260162] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.260204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.260437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.260605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.274833] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: UNINITIALIZED for 2s [ 791.275855] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.275993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.276068] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.276323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.276479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.286484] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 791.527018] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fefafe98-8990-454a-a252-19be0a2a5042',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.894666] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: SUCCESS [ 791.894666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.894666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.895117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.895117] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.030276] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.030570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.030570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.030700] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.030807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.030918] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefafe98-8990-454a-a252-19be0a2a5042 is going to be created. [ 792.052558] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.052679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.052776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.052946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.053114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.062986] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefafe98-8990-454a-a252-19be0a2a5042 in Status: UNINITIALIZED for 2s [ 792.399284] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.399284] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.846732] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: SUCCESS [ 792.846957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.847143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.847357] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.847557] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.847674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.847738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.847913] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.847996] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.848100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.848193] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.285532] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: SUCCESS [ 793.285884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.286824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.287062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.287272] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.287407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.287453] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.287607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.287689] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.287794] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.294345] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 793.294581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.294734] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.294918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.295150] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.295291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.295368] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.295501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.295581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.295669] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.349938] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.350105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.350205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.350388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.350600] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.350664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.350700] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.350948] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.350948] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.351117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.351169] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.354319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.354319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.354319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.354319] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.354319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.354319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.354319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.354319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.354319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.354319] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.789757] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.797451] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.856272] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab904195-351a-49c6-8462-7f952d95cf87: rpc.has_security_group_logging(os_id): False [ 793.875628] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.875773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.875952] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.876095] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.876191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.876479] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.876564] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.876564] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.876762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.877444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.877444] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.877444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.877444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.877444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.877444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.877901] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.877901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.877901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.881668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.881668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.881668] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be updated. [ 793.939026] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.939026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.939026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.939297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.939362] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.952514] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: IN_PROGRESS for 2s [ 794.074374] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefafe98-8990-454a-a252-19be0a2a5042 in Status: SUCCESS [ 794.074601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.074767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.074991] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.075173] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.075288] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.075358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.075512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.075589] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.075681] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefafe98-8990-454a-a252-19be0a2a5042',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.292607] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.300949] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.370960] env[69637]: INFO networking_nsxv3.common.synchronization [req-83c22b8e-129d-4ca3-a842-28ebd67ab7ae req-ee140fcd-7922-4269-a676-a317401152fd tempest-ServerAddressesTestJSON-1561336103 tempest-ServerAddressesTestJSON-1561336103-project-member] Enqueued Resource ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 with Priority: HIGHEST for action security_group_members [ 794.371238] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 with Priority: HIGHEST for action security_group_members [ 794.371569] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-77e45333-e861-4952-94f1-dfd9a9a2ed58 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.371694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.371775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.373784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.373980] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.374114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.374249] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.374511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.374716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.374868] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77e45333-e861-4952-94f1-dfd9a9a2ed58',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.578108] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fefafe98-8990-454a-a252-19be0a2a5042',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.798310] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.798458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.798496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.798694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.798782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.798881] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 is going to be updated. [ 794.802369] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.802510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.802580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.802760] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.802845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.802943] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 794.831554] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.831707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.831778] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.831982] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.832136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.834077] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.834201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.834268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.834435] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.834563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.844859] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 794.845356] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: IN_PROGRESS for 2s [ 794.878360] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.878526] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.878591] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.878802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.878893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.879135] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.879204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.879243] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.879380] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.879455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.879539] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 already deleted. [ 794.879616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.916012] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.917507] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-467" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.917507] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-467" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.917507] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-467" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.917507] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.917507] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.917507] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.918534] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.921146] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.921146] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.921146] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.921146] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.921146] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.921146] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.921146] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.921146] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.937268] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.937437] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 794.937579] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.937766] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-467" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.938069] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-7b274f0a-602c-45bd-afa6-b23d654b790c taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.938239] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-7b274f0a-602c-45bd-afa6-b23d654b790c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.938361] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-7b274f0a-602c-45bd-afa6-b23d654b790c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.938683] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-7b274f0a-602c-45bd-afa6-b23d654b790c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.938822] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b274f0a-602c-45bd-afa6-b23d654b790c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.081079] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fefafe98-8990-454a-a252-19be0a2a5042',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.443210] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.443572] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.443634] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.443929] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.445216] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.445216] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 7b274f0a-602c-45bd-afa6-b23d654b790c not found, creating... [ 795.445216] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.445216] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.445216] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.445216] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.445216] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.445524] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.445713] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.445883] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.446172] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.446172] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.446331] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 7b274f0a-602c-45bd-afa6-b23d654b790c is going to be created. [ 795.466628] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.466628] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.466628] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.466628] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.466628] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.466628] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-7b274f0a-602c-45bd-afa6-b23d654b790c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.583289] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.583489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.583535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.583730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.583811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.583910] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefafe98-8990-454a-a252-19be0a2a5042 is going to be updated. [ 795.630673] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.630882] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.630882] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.631159] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.631277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.642373] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefafe98-8990-454a-a252-19be0a2a5042 in Status: IN_PROGRESS for 2s [ 795.963849] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: SUCCESS [ 795.964091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.370039] env[69637]: INFO networking_nsxv3.common.synchronization [req-83c22b8e-129d-4ca3-a842-28ebd67ab7ae req-e7533b02-289c-475e-85a3-02bf8b2fbd53 service nova] Enqueued Resource ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 with Priority: HIGHEST for action security_group_rules [ 796.370216] env[69637]: INFO networking_nsxv3.common.synchronization [req-83c22b8e-129d-4ca3-a842-28ebd67ab7ae req-e7533b02-289c-475e-85a3-02bf8b2fbd53 service nova] Enqueued Resource ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 with Priority: HIGHEST for action security_group_members [ 796.370216] env[69637]: INFO networking_nsxv3.common.synchronization [req-83c22b8e-129d-4ca3-a842-28ebd67ab7ae req-e7533b02-289c-475e-85a3-02bf8b2fbd53 service nova] Enqueued Resource ID: 7b274f0a-602c-45bd-afa6-b23d654b790c with Priority: HIGHEST for action port [ 796.370441] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 with Priority: HIGHEST for action security_group_rules [ 796.370568] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 with Priority: HIGHEST for action security_group_members [ 796.370687] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b274f0a-602c-45bd-afa6-b23d654b790c with Priority: HIGHEST for action port [ 796.371379] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77e45333-e861-4952-94f1-dfd9a9a2ed58 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.371542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.371804] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.371804] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.372029] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77e45333-e861-4952-94f1-dfd9a9a2ed58',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.372807] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-77e45333-e861-4952-94f1-dfd9a9a2ed58 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.372983] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.372983] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.373204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.373329] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.373468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.373570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.373802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.373802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.374098] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77e45333-e861-4952-94f1-dfd9a9a2ed58',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.377169] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b274f0a-602c-45bd-afa6-b23d654b790c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.377169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b274f0a-602c-45bd-afa6-b23d654b790c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.377169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b274f0a-602c-45bd-afa6-b23d654b790c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.377169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b274f0a-602c-45bd-afa6-b23d654b790c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.377169] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b274f0a-602c-45bd-afa6-b23d654b790c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.858292] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 796.858567] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.859277] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: SUCCESS [ 796.859452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.859615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.859832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.860045] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.861230] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.861330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.861794] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.861794] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.861794] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.862047] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.862763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.863136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.863215] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.863332] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.863332] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.863627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.863627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.863754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.863816] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.864748] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.864928] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.869208] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.869208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.869208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.869208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.869208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.869208] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.869208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.869208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.869208] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.869208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.869208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.869208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.869208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.869208] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.878944] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77e45333-e861-4952-94f1-dfd9a9a2ed58',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.880143] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-77e45333-e861-4952-94f1-dfd9a9a2ed58 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.880344] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.880497] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b274f0a-602c-45bd-afa6-b23d654b790c with status ACTIVE [ 796.880676] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.880787] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.880846] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.881066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.881158] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.881758] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.881758] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.881758] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.882251] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.882371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.882666] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.882860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.883276] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.883520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.883655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.883828] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b274f0a-602c-45bd-afa6-b23d654b790c is going to be updated. [ 796.904353] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.904526] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.904569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.904953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.904953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.905148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b274f0a-602c-45bd-afa6-b23d654b790c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.053164] env[69637]: INFO networking_nsxv3.common.synchronization [req-0897ab8d-8f55-405d-85cc-215dc82003c4 req-3a77a4b3-5017-4858-af28-ce409b3bf1f8 tempest-ServerActionsTestOtherA-1708466346 tempest-ServerActionsTestOtherA-1708466346-project-member] Enqueued Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_members [ 797.053164] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_members [ 797.053164] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-69c7681d-644f-47c6-8228-9fc17f49b5a3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.053164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.053164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.053919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.056211] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.056211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.056211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.056211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.056211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.056211] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.365966] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.365966] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.372027] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.374225] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.374225] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.387214] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77e45333-e861-4952-94f1-dfd9a9a2ed58',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.557614] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.558016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.558150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.559178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.559357] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.560404] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.562091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.562091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.562091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.562091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.562091] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 already deleted. [ 797.562091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.652794] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefafe98-8990-454a-a252-19be0a2a5042 in Status: SUCCESS [ 797.653048] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.653401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.653619] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.653907] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.654053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.654137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.654303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.654394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.654932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.655076] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fefafe98-8990-454a-a252-19be0a2a5042',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.874820] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad77a84e-935d-4f36-9c82-e497b2b9c639: rpc.has_security_group_logging(os_id): False [ 797.875970] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.876892] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.891147] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.891147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.891147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.891147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.891147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.891147] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 is going to be created. [ 797.897628] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.897628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.897628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.897826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.897897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.898160] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.898268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.898313] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.898461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.898548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.898613] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 is going to be created. [ 797.922322] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.922533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.922606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.922822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.922984] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.932832] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 in Status: UNINITIALIZED for 2s [ 797.973141] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.973346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.973441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.973684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.973901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.992850] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-310 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.993123] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.996966] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.996966] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.996966] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.996966] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.996966] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.996966] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.996966] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.996966] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.996966] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.996966] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.996966] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.996966] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.996966] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.996966] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.998441] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: IN_PROGRESS for 2s [ 798.029268] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.029268] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 798.029268] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.029268] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.029268] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-3a40a546-95df-4463-b350-c975f99c10f1 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.029268] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-3a40a546-95df-4463-b350-c975f99c10f1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.029268] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-3a40a546-95df-4463-b350-c975f99c10f1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.029268] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-3a40a546-95df-4463-b350-c975f99c10f1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.029268] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a40a546-95df-4463-b350-c975f99c10f1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.158493] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fefafe98-8990-454a-a252-19be0a2a5042',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.174873] env[69637]: INFO networking_nsxv3.common.synchronization [req-c66b63fc-c0d9-4e9f-ac93-db7410890e8a req-3b596bb5-531c-4673-baea-a7705c08d363 tempest-ListImageFiltersTestJSON-1967239197 tempest-ListImageFiltersTestJSON-1967239197-project-member] Enqueued Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_members [ 798.174873] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_members [ 798.174873] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed080368-c954-48e2-a0f1-c55ff7a728fd taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.174873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.174873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.174873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.174873] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.174873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.174873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.174873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.174873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.174873] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.296366] env[69637]: INFO networking_nsxv3.common.synchronization [req-19592e27-b45c-48c3-9f83-82181f3d2cbb req-9b2601f7-9794-4317-b39e-a70d5d1f3fbf tempest-ImagesTestJSON-1924392618 tempest-ImagesTestJSON-1924392618-project-member] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 798.297171] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 798.297339] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.297339] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.297437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.298967] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.298967] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.298967] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.298967] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.298967] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.300637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.300743] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.380641] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.380816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.380872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.381098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.381559] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.381698] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 is going to be updated. [ 798.386465] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.386671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.386671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.386897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.386956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.387059] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 798.427063] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.427063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.427063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.427063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.427339] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.429388] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.429388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.429683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.429878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.430045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.439022] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: IN_PROGRESS for 2s [ 798.439729] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 798.532210] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.532731] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.533136] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.533496] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.533777] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.534028] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 3a40a546-95df-4463-b350-c975f99c10f1 not found, creating... [ 798.534395] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.534670] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.534849] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.535180] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.535456] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.535855] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.536141] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.536385] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.536848] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.537557] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.537557] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 3a40a546-95df-4463-b350-c975f99c10f1 is going to be created. [ 798.560629] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.560629] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.560629] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.560629] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.560629] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.560629] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-3a40a546-95df-4463-b350-c975f99c10f1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.664055] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fefafe98-8990-454a-a252-19be0a2a5042: rpc.has_security_group_logging(os_id): False [ 798.666584] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.689265] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.689454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.689535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.689744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.689854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.690124] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.690264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.690348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.690613] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.690710] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.690806] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fefafe98-8990-454a-a252-19be0a2a5042 is going to be created. [ 798.763020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.763020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.763020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.763020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.763020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.773114] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefafe98-8990-454a-a252-19be0a2a5042 in Status: IN_PROGRESS for 2s [ 798.804152] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.808094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.808094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.809369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.809369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.813156] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.813156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.813156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.813156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.813156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.813156] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 798.851896] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.852054] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.852141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.852408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.853534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.862764] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 799.168683] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.297460] env[69637]: INFO networking_nsxv3.common.synchronization [req-eb03467b-e58d-4c8c-8690-b07ed5a79eb2 req-ac55a407-78b8-407c-9a19-a3d190805a56 tempest-MultipleCreateTestJSON-1546211828 tempest-MultipleCreateTestJSON-1546211828-project-member] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 799.298015] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 799.298322] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.298445] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.298511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.298785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.298851] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.298946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.299017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.299461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.299555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.299653] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.594927] env[69637]: INFO networking_nsxv3.common.synchronization [req-f31982f5-96a6-418c-85a6-9eaff3bb9717 req-606d5fe5-3679-43e3-8f9f-d12f271ec0bb tempest-MultipleCreateTestJSON-1546211828 tempest-MultipleCreateTestJSON-1546211828-project-member] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 799.596484] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 799.597044] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.597044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.670646] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.670983] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.674016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.674016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.674016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.674016] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed080368-c954-48e2-a0f1-c55ff7a728fd is going to be updated. [ 799.704246] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.704246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.704246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.704246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.704246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.715364] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed080368-c954-48e2-a0f1-c55ff7a728fd in Status: IN_PROGRESS for 2s [ 799.782699] env[69637]: INFO networking_nsxv3.common.synchronization [req-0897ab8d-8f55-405d-85cc-215dc82003c4 req-581952d8-0a22-4614-89e1-fe33b0a54ea8 service nova] Enqueued Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_rules [ 799.782699] env[69637]: INFO networking_nsxv3.common.synchronization [req-0897ab8d-8f55-405d-85cc-215dc82003c4 req-581952d8-0a22-4614-89e1-fe33b0a54ea8 service nova] Enqueued Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_members [ 799.782699] env[69637]: INFO networking_nsxv3.common.synchronization [req-0897ab8d-8f55-405d-85cc-215dc82003c4 req-581952d8-0a22-4614-89e1-fe33b0a54ea8 service nova] Enqueued Resource ID: 3a40a546-95df-4463-b350-c975f99c10f1 with Priority: HIGHEST for action port [ 799.782699] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_rules [ 799.782699] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_members [ 799.787066] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a40a546-95df-4463-b350-c975f99c10f1 with Priority: HIGHEST for action port [ 799.789373] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69c7681d-644f-47c6-8228-9fc17f49b5a3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.789373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.789373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.789373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.791960] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.791960] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-69c7681d-644f-47c6-8228-9fc17f49b5a3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.791960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.791960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.791960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.792295] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.792295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.792375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.792807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.792951] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.793137] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.795965] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a40a546-95df-4463-b350-c975f99c10f1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.795965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a40a546-95df-4463-b350-c975f99c10f1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.795965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a40a546-95df-4463-b350-c975f99c10f1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.795965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a40a546-95df-4463-b350-c975f99c10f1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.795965] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a40a546-95df-4463-b350-c975f99c10f1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.802741] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.944314] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 in Status: SUCCESS [ 799.944314] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.944849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.946822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.946822] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.946822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.946822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.946822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.946822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.946822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.946822] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77e45333-e861-4952-94f1-dfd9a9a2ed58',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.012156] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: SUCCESS [ 800.012156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.012156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.012156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.012156] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.296953] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-69c7681d-644f-47c6-8228-9fc17f49b5a3 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.297234] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.298471] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.300012] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a40a546-95df-4463-b350-c975f99c10f1 with status ACTIVE [ 800.300012] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.300012] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.300012] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.300227] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.300227] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.300417] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.300511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.300570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.300721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.300800] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.300977] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.301082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.301143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.301280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.301392] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.301875] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a40a546-95df-4463-b350-c975f99c10f1 is going to be updated. [ 800.310021] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.323919] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.324128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.324128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.324334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.324477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.324629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a40a546-95df-4463-b350-c975f99c10f1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.451020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-77e45333-e861-4952-94f1-dfd9a9a2ed58 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.451020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.451020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.451020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.451020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.451020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.451020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.451020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.451020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.451020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.451020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-77e45333-e861-4952-94f1-dfd9a9a2ed58 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.451020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.451020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.451020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.451020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.451020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.451961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.451961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.451961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.451961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.451961] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77e45333-e861-4952-94f1-dfd9a9a2ed58',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.454923] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: SUCCESS [ 800.454981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.455168] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.455377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.455535] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.455640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.455705] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.455848] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.455988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.456046] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.459027] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 800.459027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.459650] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.459864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.460912] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.460912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.460912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.460912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.460912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.461177] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.517491] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad77a84e-935d-4f36-9c82-e497b2b9c639 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.517624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.785217] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefafe98-8990-454a-a252-19be0a2a5042 in Status: SUCCESS [ 800.785377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.803880] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.814525] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.814525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.814525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.814525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.814525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.814525] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be updated. [ 800.841174] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.841347] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.841418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.841734] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.841936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.855848] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: IN_PROGRESS for 2s [ 800.870353] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 800.870655] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 deletion is rescheduled due to dependency. [ 800.872017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.953892] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77e45333-e861-4952-94f1-dfd9a9a2ed58: rpc.has_security_group_logging(os_id): False [ 800.963150] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.965148] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.972181] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.973081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.973081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.973081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.973193] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.974632] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.974632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.974632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.974632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.974632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.974632] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.974632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.974632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.974632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.974632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.974632] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.974632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.974632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.975466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.975466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.975466] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 is going to be created. [ 801.035170] env[69637]: INFO networking_nsxv3.common.synchronization [req-c4bf5a28-3150-4411-9b69-512f384db019 req-c2d1b880-c758-424a-8cf6-d199949e82f5 tempest-AttachInterfacesUnderV243Test-1189967474 tempest-AttachInterfacesUnderV243Test-1189967474-project-member] Enqueued Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_members [ 801.035170] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_members [ 801.035718] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.036014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.036251] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.036631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.036943] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.037268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.037464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.037816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.038145] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.038365] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.047471] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.047471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.047471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.047471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.047471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.058049] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 in Status: IN_PROGRESS for 2s [ 801.154180] env[69637]: INFO networking_nsxv3.common.synchronization [None req-5807180f-4396-4ba0-a359-18376007b21c None None] Enqueued Resource ID: 4c594006-ef00-4faa-93ad-8d8b4c9b3532 with Priority: HIGHEST for action port [ 801.156017] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c594006-ef00-4faa-93ad-8d8b4c9b3532 with Priority: HIGHEST for action port [ 801.156017] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c594006-ef00-4faa-93ad-8d8b4c9b3532 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.156017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c594006-ef00-4faa-93ad-8d8b4c9b3532" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.156017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c594006-ef00-4faa-93ad-8d8b4c9b3532" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.156017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c594006-ef00-4faa-93ad-8d8b4c9b3532" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.156017] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c594006-ef00-4faa-93ad-8d8b4c9b3532',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.309111] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.309111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.309111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.309111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.309111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.309111] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 is going to be created. [ 801.343721] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.344140] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.344676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.344764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.345359] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.355768] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 in Status: UNINITIALIZED for 2s [ 801.472497] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.472497] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.545931] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.549066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.549066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.551062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.551062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.551062] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.551062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.551062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.551062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.551062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.551062] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b419c77-3987-4359-99fb-b76e7165ba63 already deleted. [ 801.551062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.657427] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c594006-ef00-4faa-93ad-8d8b4c9b3532 [ 801.657589] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.657695] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.657775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.657960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.658061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.658152] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c594006-ef00-4faa-93ad-8d8b4c9b3532 already deleted. [ 801.658231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c594006-ef00-4faa-93ad-8d8b4c9b3532" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.724429] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed080368-c954-48e2-a0f1-c55ff7a728fd in Status: SUCCESS [ 801.724605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.761339] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.761540] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-660" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.761725] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-660" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.762174] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-660" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.762422] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.762657] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.762733] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.762961] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.763128] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.763360] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.763531] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.763651] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.765608] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.765608] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.765608] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.765608] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.786045] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.786045] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 801.786045] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.786045] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-660" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.786045] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-7c825412-dcb7-4362-b92a-1fd671f13480 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.786045] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.786045] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.786045] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.788217] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c825412-dcb7-4362-b92a-1fd671f13480',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.974150] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.974388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.974388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.974640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.974744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.974846] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 is going to be updated. [ 801.976214] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.976335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.976410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.976655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.976783] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.976880] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 802.005782] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.005893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.005893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.006142] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.006289] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.008213] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.008213] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.008464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.008464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.008612] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.018654] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 802.018654] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: IN_PROGRESS for 2s [ 802.292977] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.293247] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.293378] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.293717] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.293891] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.294090] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 7c825412-dcb7-4362-b92a-1fd671f13480 not found, creating... [ 802.294383] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.294546] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.294672] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.294939] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.295110] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.295413] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.295575] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.295704] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.295930] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.297039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.297039] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 7c825412-dcb7-4362-b92a-1fd671f13480 is going to be created. [ 802.318620] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.318620] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.318620] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.318620] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.318620] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.318620] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.865343] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: SUCCESS [ 802.865967] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.866522] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.866737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.866935] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.867377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.867377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.867558] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.867667] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.867787] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.069789] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 in Status: SUCCESS [ 803.070036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.372363] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 in Status: SUCCESS [ 803.372363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.372363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.372363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.372363] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.372363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.372363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.372363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.372363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.372363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.372363] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.374713] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.380011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.380011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.380208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.380208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.382535] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.382535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.382535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.382535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.382535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.382535] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be updated. [ 803.406031] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.406031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.406031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.406031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.406031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.413198] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: IN_PROGRESS for 2s [ 803.432171] env[69637]: INFO networking_nsxv3.common.synchronization [None req-da6c5232-be28-41d2-a565-f279a26a5533 None None] Enqueued Resource ID: 5e53d031-9bdc-441b-9742-1ad00fd8e3d9 with Priority: HIGHEST for action port [ 803.432418] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e53d031-9bdc-441b-9742-1ad00fd8e3d9 with Priority: HIGHEST for action port [ 803.432993] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e53d031-9bdc-441b-9742-1ad00fd8e3d9 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.433136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e53d031-9bdc-441b-9742-1ad00fd8e3d9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.433207] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e53d031-9bdc-441b-9742-1ad00fd8e3d9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.433466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e53d031-9bdc-441b-9742-1ad00fd8e3d9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.433577] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e53d031-9bdc-441b-9742-1ad00fd8e3d9',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.564017] env[69637]: INFO networking_nsxv3.common.synchronization [None req-62fd9be4-a7a8-4ab2-985a-cb263a3c3798 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 1236a1fa-0205-4a17-909f-c8686b475a69 with Priority: HIGHEST for action security_group_rules [ 803.564766] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1236a1fa-0205-4a17-909f-c8686b475a69 with Priority: HIGHEST for action security_group_rules [ 803.569022] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1236a1fa-0205-4a17-909f-c8686b475a69 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.569022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.569022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.569022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.569022] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1236a1fa-0205-4a17-909f-c8686b475a69',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.852650] env[69637]: INFO networking_nsxv3.common.synchronization [req-c4bf5a28-3150-4411-9b69-512f384db019 req-559aac66-5650-4b43-b56d-514c73827833 service nova] Enqueued Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_rules [ 803.852650] env[69637]: INFO networking_nsxv3.common.synchronization [req-c4bf5a28-3150-4411-9b69-512f384db019 req-559aac66-5650-4b43-b56d-514c73827833 service nova] Enqueued Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_members [ 803.852650] env[69637]: INFO networking_nsxv3.common.synchronization [req-c4bf5a28-3150-4411-9b69-512f384db019 req-559aac66-5650-4b43-b56d-514c73827833 service nova] Enqueued Resource ID: 7c825412-dcb7-4362-b92a-1fd671f13480 with Priority: HIGHEST for action port [ 803.853815] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_rules [ 803.853956] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_members [ 803.854150] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c825412-dcb7-4362-b92a-1fd671f13480 with Priority: HIGHEST for action port [ 803.854402] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.855125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.856071] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.856071] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.856071] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.857646] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.858094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.858201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.858429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.858679] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.858821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.858940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.859101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.859237] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.859691] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.860644] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c825412-dcb7-4362-b92a-1fd671f13480 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.860644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.860644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.862356] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.862356] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c825412-dcb7-4362-b92a-1fd671f13480',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.875842] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.921837] env[69637]: INFO networking_nsxv3.common.synchronization [None req-0b84f469-e723-4df4-99ad-3175ce404876 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 1236a1fa-0205-4a17-909f-c8686b475a69 with Priority: HIGHEST for action security_group_rules [ 803.922554] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1236a1fa-0205-4a17-909f-c8686b475a69 with Priority: HIGHEST for action security_group_rules [ 803.923664] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1236a1fa-0205-4a17-909f-c8686b475a69 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.923664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.937256] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e53d031-9bdc-441b-9742-1ad00fd8e3d9 [ 803.937410] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.937539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.937636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.937811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.938024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.938024] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e53d031-9bdc-441b-9742-1ad00fd8e3d9 already deleted. [ 803.938125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e53d031-9bdc-441b-9742-1ad00fd8e3d9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.949569] env[69637]: INFO networking_nsxv3.common.synchronization [req-6754798c-1213-4c18-b084-0fbefa06d09c req-164a26ed-e827-4a31-b841-812d0eb3b79e tempest-ServerMetadataNegativeTestJSON-881689973 tempest-ServerMetadataNegativeTestJSON-881689973-project-member] Enqueued Resource ID: 5113e882-e54a-4682-8961-555e92283cef with Priority: HIGHEST for action security_group_members [ 803.950103] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5113e882-e54a-4682-8961-555e92283cef with Priority: HIGHEST for action security_group_members [ 803.950413] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5113e882-e54a-4682-8961-555e92283cef taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.950684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.950684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.951472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.951637] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.951744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.951802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.952317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.952317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.952317] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5113e882-e54a-4682-8961-555e92283cef',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.012194] env[69637]: INFO networking_nsxv3.common.synchronization [None req-398970a4-d06e-427f-9b02-cbaf3cfb9b4d None None] Enqueued Resource ID: 107eb290-5da4-4f2e-a5a9-6811f1101511 with Priority: HIGHEST for action port [ 804.012585] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 107eb290-5da4-4f2e-a5a9-6811f1101511 with Priority: HIGHEST for action port [ 804.012874] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-107eb290-5da4-4f2e-a5a9-6811f1101511 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.013965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-107eb290-5da4-4f2e-a5a9-6811f1101511" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.014079] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-107eb290-5da4-4f2e-a5a9-6811f1101511" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.014294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-107eb290-5da4-4f2e-a5a9-6811f1101511" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.014508] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('107eb290-5da4-4f2e-a5a9-6811f1101511',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.031697] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 804.031910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.032613] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: SUCCESS [ 804.032804] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.033248] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.036375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.036571] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.036687] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.036747] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.036897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.036972] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.037351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.037520] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.037614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.037672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.037811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.038876] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.038876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.038876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.038876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.038876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.038876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.038876] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.039683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.039760] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.039901] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.040009] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.040228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.040393] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.040474] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.040560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.040809] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.093894] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.094057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.094129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.094340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.094429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.094524] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1236a1fa-0205-4a17-909f-c8686b475a69 already deleted. [ 804.094608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.094757] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.094908] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.095020] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1236a1fa-0205-4a17-909f-c8686b475a69',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.329704] env[69637]: INFO networking_nsxv3.common.synchronization [req-d6840911-6c4f-4030-b9f5-848bf84f50e3 req-018857dc-d96e-472f-ad8c-923ee91ed70e tempest-ServerDiskConfigTestJSON-538739594 tempest-ServerDiskConfigTestJSON-538739594-project-member] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 804.331296] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 804.331296] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.331296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.331296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.331296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.331296] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.333532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.333836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.333947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.334062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.335044] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.363561] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.363561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.365024] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.365267] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c825412-dcb7-4362-b92a-1fd671f13480 with status ACTIVE [ 804.365455] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.365611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.365667] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.365835] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.366010] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.366114] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.366214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.366271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.366418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.366501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.366742] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.366742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.366876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.366950] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.367013] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.367093] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c825412-dcb7-4362-b92a-1fd671f13480 is going to be updated. [ 804.377884] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69c7681d-644f-47c6-8228-9fc17f49b5a3: rpc.has_security_group_logging(os_id): False [ 804.391869] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.392083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.392083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.392298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.392423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.392597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.395494] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.395494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.395494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.395494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.395494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.395883] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.395883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.395968] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.396220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.396268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.396383] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 is going to be created. [ 804.455352] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.455501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.455574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.455786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.455981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.457119] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.457232] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.457301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.457461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.457541] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.457707] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.457801] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.457873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.457993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.458301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.458419] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5113e882-e54a-4682-8961-555e92283cef already deleted. [ 804.458527] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.475117] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 in Status: IN_PROGRESS for 2s [ 804.517965] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 107eb290-5da4-4f2e-a5a9-6811f1101511 [ 804.517965] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.517965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.517965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.517965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.517965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.517965] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:107eb290-5da4-4f2e-a5a9-6811f1101511 already deleted. [ 804.517965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-107eb290-5da4-4f2e-a5a9-6811f1101511" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.542784] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1db16c79-2ca0-4113-99b1-64acc68fd18a: rpc.has_security_group_logging(os_id): False [ 804.546491] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.567414] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.567673] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.567784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.568061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.568214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.568496] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.568578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.568648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.569220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.569220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.569220] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.569394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.569394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.569608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.569872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.570916] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.571057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.571183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.571282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.571363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.571459] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 804.618201] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.619026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.619026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.619026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.619026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.620289] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1236a1fa-0205-4a17-909f-c8686b475a69 already deleted. [ 804.620289] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.646647] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.646647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.646647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.646647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.646647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.662173] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 804.837908] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.838291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.841817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.841817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.841817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.841817] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.841817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.841817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.841817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.841817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.841817] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 804.869901] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.870019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.870154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.870373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.870541] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.873065] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.882146] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 805.038548] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-767 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.038707] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-767" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.039161] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-767" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.039161] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-767" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.039298] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.039447] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.039770] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.039900] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.039938] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.041196] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.041281] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.041438] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.041599] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.041651] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.041762] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.041900] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.052318] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad77a84e-935d-4f36-9c82-e497b2b9c639: rpc.has_security_group_logging(os_id): False [ 805.062857] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.063037] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 805.063175] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.063346] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-767" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.063648] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-afee6e8a-113e-452a-a787-56f4e9319a9d taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.063825] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-afee6e8a-113e-452a-a787-56f4e9319a9d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.063940] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-afee6e8a-113e-452a-a787-56f4e9319a9d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.064282] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-afee6e8a-113e-452a-a787-56f4e9319a9d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.064417] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afee6e8a-113e-452a-a787-56f4e9319a9d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.068794] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.068856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.068930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.069166] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.069211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.070295] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.070295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.070295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.070295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.070295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.070295] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 is going to be updated. [ 805.121671] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.121763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.122043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.122043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.122194] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.134548] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: IN_PROGRESS for 2s [ 805.379503] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.379503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.379503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.379503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.379503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.379503] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b419c77-3987-4359-99fb-b76e7165ba63 is going to be created. [ 805.405299] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.405299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.405299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.405299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.405299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.416670] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b419c77-3987-4359-99fb-b76e7165ba63 in Status: UNINITIALIZED for 2s [ 805.419710] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: SUCCESS [ 805.419917] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab904195-351a-49c6-8462-7f952d95cf87 deletion is rescheduled due to dependency. [ 805.420071] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.566480] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.566749] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.566886] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.567199] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.567351] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.567507] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port afee6e8a-113e-452a-a787-56f4e9319a9d not found, creating... [ 805.567800] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.567960] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.568091] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.568315] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.568454] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.568740] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.568890] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.569110] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.569228] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.569362] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.569508] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: afee6e8a-113e-452a-a787-56f4e9319a9d is going to be created. [ 805.588482] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.588673] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.588870] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.589109] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.589361] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.589594] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-afee6e8a-113e-452a-a787-56f4e9319a9d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.299490] env[69637]: INFO networking_nsxv3.common.synchronization [req-df12ce5a-8387-4abc-b991-be9f9e41b429 req-11ac7745-9c59-459a-92e5-44b19ffc1aeb tempest-ServersTestMultiNic-1929872957 tempest-ServersTestMultiNic-1929872957-project-member] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 806.301467] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 806.301837] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.302078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.302483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.303752] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.303752] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.303923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.303923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.304570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.304570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.304570] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.332938] env[69637]: INFO networking_nsxv3.common.synchronization [req-6754798c-1213-4c18-b084-0fbefa06d09c req-46be25ea-2931-4cef-936e-b7e9f71c9a4c service nova] Enqueued Resource ID: 5113e882-e54a-4682-8961-555e92283cef with Priority: HIGHEST for action security_group_rules [ 806.333139] env[69637]: INFO networking_nsxv3.common.synchronization [req-6754798c-1213-4c18-b084-0fbefa06d09c req-46be25ea-2931-4cef-936e-b7e9f71c9a4c service nova] Enqueued Resource ID: 5113e882-e54a-4682-8961-555e92283cef with Priority: HIGHEST for action security_group_members [ 806.333280] env[69637]: INFO networking_nsxv3.common.synchronization [req-6754798c-1213-4c18-b084-0fbefa06d09c req-46be25ea-2931-4cef-936e-b7e9f71c9a4c service nova] Enqueued Resource ID: afee6e8a-113e-452a-a787-56f4e9319a9d with Priority: HIGHEST for action port [ 806.333999] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5113e882-e54a-4682-8961-555e92283cef with Priority: HIGHEST for action security_group_rules [ 806.334154] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5113e882-e54a-4682-8961-555e92283cef with Priority: HIGHEST for action security_group_members [ 806.334286] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afee6e8a-113e-452a-a787-56f4e9319a9d with Priority: HIGHEST for action port [ 806.334827] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5113e882-e54a-4682-8961-555e92283cef taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.334953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.335039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.335432] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.335538] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5113e882-e54a-4682-8961-555e92283cef',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.336341] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5113e882-e54a-4682-8961-555e92283cef taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.336479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.336549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.336745] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.337116] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.337116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.337116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.337334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.337334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.337433] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5113e882-e54a-4682-8961-555e92283cef',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.338121] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-afee6e8a-113e-452a-a787-56f4e9319a9d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.338230] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afee6e8a-113e-452a-a787-56f4e9319a9d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.338296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afee6e8a-113e-452a-a787-56f4e9319a9d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.338448] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afee6e8a-113e-452a-a787-56f4e9319a9d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.338521] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afee6e8a-113e-452a-a787-56f4e9319a9d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.489317] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 in Status: SUCCESS [ 806.489317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.676205] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 806.676478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.676982] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.677339] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.677414] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.806026] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.806160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.806206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.806625] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.806625] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.806749] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.806882] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.806882] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.807086] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.807086] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.807982] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be updated. [ 806.821979] env[69637]: INFO networking_nsxv3.common.synchronization [None req-bffb361f-ea5c-49aa-bee5-a0994410f9e8 None None] Enqueued Resource ID: 37611549-1600-442a-82b4-162e123b0c2f with Priority: HIGHEST for action port [ 806.822857] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37611549-1600-442a-82b4-162e123b0c2f with Priority: HIGHEST for action port [ 806.824152] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-37611549-1600-442a-82b4-162e123b0c2f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.824304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37611549-1600-442a-82b4-162e123b0c2f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.824348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37611549-1600-442a-82b4-162e123b0c2f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.824595] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37611549-1600-442a-82b4-162e123b0c2f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.824664] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37611549-1600-442a-82b4-162e123b0c2f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.833917] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.834098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.834167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.834399] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.834537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.841481] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5113e882-e54a-4682-8961-555e92283cef',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.845075] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5113e882-e54a-4682-8961-555e92283cef taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.845075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.845075] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 806.845075] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port afee6e8a-113e-452a-a787-56f4e9319a9d with status ACTIVE [ 806.845075] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.845075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.845075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.845075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.845075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.845075] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.845075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.845075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.845075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.845075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.845626] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.845626] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.845626] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.845626] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.845626] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.845626] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: afee6e8a-113e-452a-a787-56f4e9319a9d is going to be updated. [ 806.866649] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.866649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.866649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.866649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.866649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.866649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afee6e8a-113e-452a-a787-56f4e9319a9d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.891175] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 806.891982] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac deletion is rescheduled due to dependency. [ 806.891982] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.913445] env[69637]: INFO networking_nsxv3.common.synchronization [req-df12ce5a-8387-4abc-b991-be9f9e41b429 req-b52d89c1-393e-4d2c-a4ba-353e81e4f937 tempest-ServersTestMultiNic-1929872957 tempest-ServersTestMultiNic-1929872957-project-member] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 806.914016] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 806.914353] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.914463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.149211] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: SUCCESS [ 807.149442] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.183274] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.183274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.183274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.183274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.183274] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.183560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.183560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.183560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.183724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.183724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.183815] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.330203] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37611549-1600-442a-82b4-162e123b0c2f [ 807.334298] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.334298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.334298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.334298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.334298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.334298] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37611549-1600-442a-82b4-162e123b0c2f already deleted. [ 807.334298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37611549-1600-442a-82b4-162e123b0c2f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.344774] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5113e882-e54a-4682-8961-555e92283cef',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.407662] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.407865] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-160" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.407988] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-160" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.408325] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-160" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.408585] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.409144] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.409144] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.409144] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.409359] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.409398] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.409486] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.409588] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.409689] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.409792] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.409900] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.410075] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.427246] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b419c77-3987-4359-99fb-b76e7165ba63 in Status: SUCCESS [ 807.427452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.428098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.428300] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.428468] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.428561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.428634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.428766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.428844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.428931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.429036] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.430900] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.431085] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 807.431227] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.431459] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-160" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.431804] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-346bc2b2-bf33-4e7a-95f2-c67f755bf826 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.431977] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-346bc2b2-bf33-4e7a-95f2-c67f755bf826" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.432275] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-346bc2b2-bf33-4e7a-95f2-c67f755bf826" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.432366] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-346bc2b2-bf33-4e7a-95f2-c67f755bf826" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.432499] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('346bc2b2-bf33-4e7a-95f2-c67f755bf826',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.690996] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.691321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.691321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.691454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.691639] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.691751] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.691818] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.691969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.692066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.692167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.692312] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.692403] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.692463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.692614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.692767] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.692862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.692905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.693057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.693139] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.693213] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.693301] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.807580] env[69637]: INFO networking_nsxv3.common.synchronization [req-ef8591eb-79eb-4bb1-a619-95399bfacef4 req-54f1ef91-12ab-4f65-9279-13c919d850ae tempest-ServerAddressesTestJSON-1561336103 tempest-ServerAddressesTestJSON-1561336103-project-member] Enqueued Resource ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 with Priority: HIGHEST for action security_group_members [ 807.809405] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 with Priority: HIGHEST for action security_group_members [ 807.809621] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-77e45333-e861-4952-94f1-dfd9a9a2ed58 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.809699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.809749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.809932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.811471] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.811590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.811660] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.811829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.811920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.812023] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77e45333-e861-4952-94f1-dfd9a9a2ed58',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.847296] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.847463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.847553] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.847806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.848846] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.848846] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5113e882-e54a-4682-8961-555e92283cef is going to be created. [ 807.875464] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.875618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.875672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.875877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.876608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.884789] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5113e882-e54a-4682-8961-555e92283cef in Status: UNINITIALIZED for 2s [ 807.935211] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.935465] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.935551] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.935828] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.935976] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.936140] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 346bc2b2-bf33-4e7a-95f2-c67f755bf826 not found, creating... [ 807.936397] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.936551] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.936672] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.936948] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.937135] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.937457] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.937620] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.937770] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.937939] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.938427] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.938556] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 346bc2b2-bf33-4e7a-95f2-c67f755bf826 is going to be created. [ 807.939640] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.960756] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.960979] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.961116] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.961396] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.961635] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.961861] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-346bc2b2-bf33-4e7a-95f2-c67f755bf826" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.196336] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1db16c79-2ca0-4113-99b1-64acc68fd18a: rpc.has_security_group_logging(os_id): False [ 808.212914] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.213080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.213153] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.213359] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.213452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.213665] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.213764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.213829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.214012] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.214084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.214239] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.214333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.214393] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.214530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.214604] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.214778] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.214867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.214975] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.215075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.215145] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.215224] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 808.297658] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.297658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.297658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.297857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.297857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.313238] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 808.315888] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.315888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.315888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.316099] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.316139] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.316346] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.316440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.316440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.316598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.316650] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.316738] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 is going to be updated. [ 808.340289] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.340519] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.340519] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.341054] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.341054] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.350645] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 in Status: IN_PROGRESS for 2s [ 808.444292] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b419c77-3987-4359-99fb-b76e7165ba63: rpc.has_security_group_logging(os_id): False [ 808.464120] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.464318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.464423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.464544] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.464636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.464874] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.465024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.465094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.465247] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.465324] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.465410] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b419c77-3987-4359-99fb-b76e7165ba63 is going to be created. [ 808.524697] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.524697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.524697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.524697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.524697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.533627] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b419c77-3987-4359-99fb-b76e7165ba63 in Status: IN_PROGRESS for 2s [ 808.748169] env[69637]: INFO networking_nsxv3.common.synchronization [req-df12ce5a-8387-4abc-b991-be9f9e41b429 req-f88c4fcc-c69a-4905-ace8-c8ea6321b3b4 service nova] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_rules [ 808.748418] env[69637]: INFO networking_nsxv3.common.synchronization [req-df12ce5a-8387-4abc-b991-be9f9e41b429 req-f88c4fcc-c69a-4905-ace8-c8ea6321b3b4 service nova] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 808.748517] env[69637]: INFO networking_nsxv3.common.synchronization [req-df12ce5a-8387-4abc-b991-be9f9e41b429 req-f88c4fcc-c69a-4905-ace8-c8ea6321b3b4 service nova] Enqueued Resource ID: 346bc2b2-bf33-4e7a-95f2-c67f755bf826 with Priority: HIGHEST for action port [ 808.748708] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_rules [ 808.748837] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 808.748933] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 346bc2b2-bf33-4e7a-95f2-c67f755bf826 with Priority: HIGHEST for action port [ 808.749500] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.749618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.749686] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.749881] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.750060] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.751752] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.751865] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.752051] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-346bc2b2-bf33-4e7a-95f2-c67f755bf826 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.752129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-346bc2b2-bf33-4e7a-95f2-c67f755bf826" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.752198] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-346bc2b2-bf33-4e7a-95f2-c67f755bf826" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.752453] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-346bc2b2-bf33-4e7a-95f2-c67f755bf826" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.752534] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('346bc2b2-bf33-4e7a-95f2-c67f755bf826',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.823618] env[69637]: INFO networking_nsxv3.common.synchronization [req-559f7b2e-7e00-4271-acfa-56a44a0ab165 req-6f7b3bb7-adda-478a-b4fb-788a82a824cc tempest-ServersAdminTestJSON-567435686 tempest-ServersAdminTestJSON-567435686-project-member] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 808.823880] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 808.824171] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.826383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.826383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.826383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.826383] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.826383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.826383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.826383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.826383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.826383] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.852966] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 808.853694] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae deletion is rescheduled due to dependency. [ 808.853827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.853992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.854231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.854418] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.854832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.854832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.854832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.854832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.856084] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.168332] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-255 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.168510] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.168671] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.169086] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.169523] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.169737] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.169896] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.170287] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.171451] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.173464] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.173694] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.173894] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.174114] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.174320] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.174517] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.174761] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.193230] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.193490] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 809.193723] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.194062] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.194616] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-6e9eb369-8ce2-4405-82a5-39500f54a429 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.194913] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-6e9eb369-8ce2-4405-82a5-39500f54a429" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.195243] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-6e9eb369-8ce2-4405-82a5-39500f54a429" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.195685] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-6e9eb369-8ce2-4405-82a5-39500f54a429" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.195935] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e9eb369-8ce2-4405-82a5-39500f54a429',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.252364] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.252489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.253965] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 346bc2b2-bf33-4e7a-95f2-c67f755bf826 with status ACTIVE [ 809.254237] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.254412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.254531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.254717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.254846] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.254982] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.255092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.255155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.255303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.255381] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.255598] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.255715] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.255774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.255894] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.255970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.256092] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 346bc2b2-bf33-4e7a-95f2-c67f755bf826 is going to be updated. [ 809.284975] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.285152] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.285221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.285379] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.285510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.285668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-346bc2b2-bf33-4e7a-95f2-c67f755bf826" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.329791] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.358272] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.699261] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.699577] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.699729] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.700212] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.700435] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.700583] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 6e9eb369-8ce2-4405-82a5-39500f54a429 not found, creating... [ 809.700850] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.701064] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.701173] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.701406] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.701549] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.701855] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.702139] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.702328] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.702552] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.702735] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.703052] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 6e9eb369-8ce2-4405-82a5-39500f54a429 is going to be created. [ 809.723264] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.723585] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.723585] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.723860] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.724111] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.724335] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-6e9eb369-8ce2-4405-82a5-39500f54a429" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.789070] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-144 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.789070] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-144" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.789070] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-144" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.789480] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-144" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.789614] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.789782] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.790019] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.790135] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.790277] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.790480] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.790593] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.790704] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.790813] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.790921] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.791036] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.791172] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.811095] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.811265] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 809.811404] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.811576] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-144" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.811873] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.812055] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.812176] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.812483] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.812655] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.831463] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.860331] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.894072] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5113e882-e54a-4682-8961-555e92283cef in Status: SUCCESS [ 809.894302] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.894461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.894676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.894869] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.895014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.895122] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.895222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.895304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.895392] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.895483] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5113e882-e54a-4682-8961-555e92283cef',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.317333] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.317582] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.317731] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.318175] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.318360] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.318542] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad not found, creating... [ 810.318817] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.318978] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.319687] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.319959] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.320126] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.320448] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.320626] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.320740] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.320963] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.321139] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.321279] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad is going to be created. [ 810.335977] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.336201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.336299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.336492] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.336599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.336697] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 is going to be updated. [ 810.341547] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 810.341746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.343867] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.344076] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.344201] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.344443] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.344662] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.344870] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.362479] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 in Status: SUCCESS [ 810.362479] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 deletion is rescheduled due to dependency. [ 810.362746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.363236] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.363236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.363236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.363423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.363423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.363497] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be updated. [ 810.394285] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.394436] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.394492] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.394699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.394837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.397684] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5113e882-e54a-4682-8961-555e92283cef taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.397822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.397893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.398042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.398195] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.398290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.398410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.398563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.398638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.398725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.398873] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5113e882-e54a-4682-8961-555e92283cef taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.398962] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.399036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.399165] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.399489] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.399589] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.399643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.399780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.399857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.399936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.400036] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5113e882-e54a-4682-8961-555e92283cef',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.410844] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: IN_PROGRESS for 2s [ 810.422071] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.422247] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.422316] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.422497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.422615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.438800] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 810.551046] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b419c77-3987-4359-99fb-b76e7165ba63 in Status: SUCCESS [ 810.551392] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.619634] env[69637]: INFO networking_nsxv3.common.synchronization [req-3e42167a-5c5c-47de-bf04-6de8a677c196 req-d627ccdd-c8e1-4f16-a03f-4ef3db7e1212 tempest-FloatingIPsAssociationTestJSON-1060765468 tempest-FloatingIPsAssociationTestJSON-1060765468-project-member] Enqueued Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_members [ 810.620702] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGHEST for action security_group_members [ 810.621114] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-73fa4a6e-8adc-47da-9b8e-35f70f60c275 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.621299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.621362] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.621614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.621731] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.621870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.621999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.622102] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.622226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.622332] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.903934] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5113e882-e54a-4682-8961-555e92283cef: rpc.has_security_group_logging(os_id): False [ 810.921110] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.921110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.921110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.921110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.921110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.921110] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.921110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.921110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.921110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.921110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.921110] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.921110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.921110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.921110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.921110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.922075] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.922075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.922075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.922491] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.922736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.923013] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5113e882-e54a-4682-8961-555e92283cef is going to be created. [ 810.980141] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.980141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.980141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.980141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.980141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.988412] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5113e882-e54a-4682-8961-555e92283cef in Status: IN_PROGRESS for 2s [ 811.124370] env[69637]: INFO networking_nsxv3.common.synchronization [req-559f7b2e-7e00-4271-acfa-56a44a0ab165 req-d8f1898e-6299-48d4-b9a0-8566e294b26f service nova] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_rules [ 811.124556] env[69637]: INFO networking_nsxv3.common.synchronization [req-559f7b2e-7e00-4271-acfa-56a44a0ab165 req-d8f1898e-6299-48d4-b9a0-8566e294b26f service nova] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 811.124759] env[69637]: INFO networking_nsxv3.common.synchronization [req-559f7b2e-7e00-4271-acfa-56a44a0ab165 req-d8f1898e-6299-48d4-b9a0-8566e294b26f service nova] Enqueued Resource ID: 6e9eb369-8ce2-4405-82a5-39500f54a429 with Priority: HIGHEST for action port [ 811.125225] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_rules [ 811.125225] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 811.125225] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e9eb369-8ce2-4405-82a5-39500f54a429 with Priority: HIGHEST for action port [ 811.125663] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.125807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.126025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.126218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.126218] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.127652] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.127760] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.127941] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e9eb369-8ce2-4405-82a5-39500f54a429 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.128095] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e9eb369-8ce2-4405-82a5-39500f54a429" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.128158] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e9eb369-8ce2-4405-82a5-39500f54a429" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.128519] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e9eb369-8ce2-4405-82a5-39500f54a429" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.128519] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e9eb369-8ce2-4405-82a5-39500f54a429',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.129611] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.129719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.129783] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.129938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.130062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.130226] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.130342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.130426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.130514] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.130611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.130708] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 is going to be updated. [ 811.159790] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.159790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.159790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.159790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.159790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.171931] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 in Status: IN_PROGRESS for 2s [ 811.326190] env[69637]: INFO networking_nsxv3.common.synchronization [req-df12ce5a-8387-4abc-b991-be9f9e41b429 req-03cae0ab-2553-481d-bccc-6e52e446e7c8 service nova] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_rules [ 811.326190] env[69637]: INFO networking_nsxv3.common.synchronization [req-df12ce5a-8387-4abc-b991-be9f9e41b429 req-03cae0ab-2553-481d-bccc-6e52e446e7c8 service nova] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 811.326190] env[69637]: INFO networking_nsxv3.common.synchronization [req-df12ce5a-8387-4abc-b991-be9f9e41b429 req-03cae0ab-2553-481d-bccc-6e52e446e7c8 service nova] Enqueued Resource ID: 4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad with Priority: HIGHEST for action port [ 811.326190] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_rules [ 811.326190] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 811.326190] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad with Priority: HIGHEST for action port [ 811.326190] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.326190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.326190] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.326190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.326691] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.327015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.327183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.327465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.327664] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.628616] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.628757] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.630192] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e9eb369-8ce2-4405-82a5-39500f54a429 with status ACTIVE [ 811.630386] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.631678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.631678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.631678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.631678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.631678] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.631678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.631678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.631678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.631678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.631678] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.632145] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.632145] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.632145] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.632239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.632275] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e9eb369-8ce2-4405-82a5-39500f54a429 is going to be updated. [ 811.652282] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.656022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.656022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.656022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.656022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.656022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e9eb369-8ce2-4405-82a5-39500f54a429" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.768904] env[69637]: INFO networking_nsxv3.common.synchronization [req-5b662eaa-e531-4f4c-a83f-4436f25ddec1 req-fa867a3e-ee97-4109-a5c3-b3cadb6b3644 tempest-ServersTestJSON-1659168521 tempest-ServersTestJSON-1659168521-project-member] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 811.769447] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 811.769746] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.770842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.770842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.776109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.776109] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.776109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.776109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.776109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.776109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.776109] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.829742] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad with status ACTIVE [ 811.831929] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.831929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.831929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.831929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.831929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.831929] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.831929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.831929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.831929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.832441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.832613] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.832755] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.832938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.833157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.833157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.833261] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad is going to be updated. [ 811.855529] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.855529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.855529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.855529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.855529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.855529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cd940f3-5c70-4ac8-ae05-fb756e5ec1ad" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.276835] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.277191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.277191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.277284] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.277374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.277576] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.277911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.277911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.277911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.278089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.278432] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 already deleted. [ 812.278486] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.425317] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: SUCCESS [ 812.425317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.425317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.425317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.425317] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.425317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.425317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.425317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.425317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.425317] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.454513] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 812.454513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.454513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.454513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.457389] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.457389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.457389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.457389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.457389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.457389] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.501502] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-286 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.501733] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.501843] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.502181] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.502430] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.502582] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.502731] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.502942] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.505036] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.505326] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.505452] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.505568] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.505678] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.505885] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.505921] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.506622] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.529032] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.529855] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 812.529855] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.529855] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.529855] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-36637ff3-c22a-4848-852f-7d535a1c2b3d taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.530158] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-36637ff3-c22a-4848-852f-7d535a1c2b3d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.531205] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-36637ff3-c22a-4848-852f-7d535a1c2b3d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.531742] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-36637ff3-c22a-4848-852f-7d535a1c2b3d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.532037] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36637ff3-c22a-4848-852f-7d535a1c2b3d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.927188] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.960519] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.999323] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5113e882-e54a-4682-8961-555e92283cef in Status: SUCCESS [ 812.999803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.035710] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.035931] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.036080] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.036443] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.036646] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.036745] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 36637ff3-c22a-4848-852f-7d535a1c2b3d not found, creating... [ 813.037091] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.037188] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.037297] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.037523] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.037742] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.038410] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.038410] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.038713] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.038753] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.038878] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.039040] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 36637ff3-c22a-4848-852f-7d535a1c2b3d is going to be created. [ 813.059187] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.059535] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.059745] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.060202] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.060573] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.061199] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-36637ff3-c22a-4848-852f-7d535a1c2b3d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.196028] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 in Status: SUCCESS [ 813.196028] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 deletion is rescheduled due to dependency. [ 813.196028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.429348] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.463132] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.932439] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.932633] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.932837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.932962] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.933078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.933396] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 is going to be updated. [ 813.964197] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.964400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.964680] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.964939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.965105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.967111] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.967266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.967361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.967517] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.967600] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.967854] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be updated. [ 813.976971] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: IN_PROGRESS for 2s [ 813.993954] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.994127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.994212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.994414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.994637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.006169] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 814.170745] env[69637]: INFO networking_nsxv3.common.synchronization [req-5b662eaa-e531-4f4c-a83f-4436f25ddec1 req-4fa6d7c3-94d4-467e-ab8d-c14289533c42 service nova] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_rules [ 814.171145] env[69637]: INFO networking_nsxv3.common.synchronization [req-5b662eaa-e531-4f4c-a83f-4436f25ddec1 req-4fa6d7c3-94d4-467e-ab8d-c14289533c42 service nova] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 814.172036] env[69637]: INFO networking_nsxv3.common.synchronization [req-5b662eaa-e531-4f4c-a83f-4436f25ddec1 req-4fa6d7c3-94d4-467e-ab8d-c14289533c42 service nova] Enqueued Resource ID: 36637ff3-c22a-4848-852f-7d535a1c2b3d with Priority: HIGHEST for action port [ 814.172587] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_rules [ 814.172830] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 814.172954] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36637ff3-c22a-4848-852f-7d535a1c2b3d with Priority: HIGHEST for action port [ 814.173277] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.173401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.173567] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.173720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.173871] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.174677] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.174813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.174995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.175229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.175397] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.175504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.175564] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.175720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.175806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.175903] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.176907] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-36637ff3-c22a-4848-852f-7d535a1c2b3d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.177065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36637ff3-c22a-4848-852f-7d535a1c2b3d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.177220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36637ff3-c22a-4848-852f-7d535a1c2b3d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.177279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36637ff3-c22a-4848-852f-7d535a1c2b3d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.177336] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36637ff3-c22a-4848-852f-7d535a1c2b3d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.678807] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.679187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.679241] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.681052] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36637ff3-c22a-4848-852f-7d535a1c2b3d with status ACTIVE [ 814.684019] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.684019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.684019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.684019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.684019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.684019] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.684019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.684019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.684019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.684019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.684019] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.684019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.684019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.684756] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.684756] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.684756] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36637ff3-c22a-4848-852f-7d535a1c2b3d is going to be updated. [ 814.704241] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.704432] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.704617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.705131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.705363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.705564] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36637ff3-c22a-4848-852f-7d535a1c2b3d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.181789] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.684615] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.684959] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.684959] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.684959] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.685155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.685155] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be created. [ 815.706859] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.706859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.707100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.707146] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.707334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.716351] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: UNINITIALIZED for 2s [ 815.991330] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: SUCCESS [ 815.991560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.991867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.991969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.993600] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.994067] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.994067] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.994067] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.994067] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.994670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.994670] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.021103] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 816.021288] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.021418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.021631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.021824] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.021942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.022715] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.022715] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.022715] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.022715] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.022715] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.027019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.027019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.027019] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.027019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.027019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.027019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.027019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.027019] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.500027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.500027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.500027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.500027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.500027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.500027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.500027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.500027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.500027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.500027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.500027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.500027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.500027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.500027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.500027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.500027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.501033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.501033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.501033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.501033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.501033] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.525054] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.525463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.526884] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.006572] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff9b407c-6313-458e-a95d-b00d9b8914d1: rpc.has_security_group_logging(os_id): False [ 817.023837] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.024030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.024150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.024455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.024611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.024841] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.025029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.025149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.025383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.025595] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.025595] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.025702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.025742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.025958] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.026072] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.026260] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.026576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.026576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.027124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.027124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.027124] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 is going to be updated. [ 817.029404] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.087239] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.087438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.087491] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.087701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.087860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.102381] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: IN_PROGRESS for 2s [ 817.108894] env[69637]: INFO networking_nsxv3.common.synchronization [req-0424b17c-1c5f-4a6a-8ca1-f3003b4c7241 req-13177d32-07da-44fa-a8c4-847d88ec0010 tempest-ListServerFiltersTestJSON-297691074 tempest-ListServerFiltersTestJSON-297691074-project-member] Enqueued Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 817.108894] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGHEST for action security_group_members [ 817.113028] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.113173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.113255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.113466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.113681] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.113795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.113795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.113974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.114088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.114186] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.531506] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.531717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.531790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.532019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.532110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.532210] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be updated. [ 817.598325] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.598325] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.598325] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.598325] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.598325] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.611330] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 817.619897] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.619897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.619897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.619897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.619897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.619897] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.619897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.619897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.619897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.619897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.619897] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 is going to be updated. [ 817.665808] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.665808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.665808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.665808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.665808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.675726] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: IN_PROGRESS for 2s [ 817.731259] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 817.731431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.731602] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.731817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.731997] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.732118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.732180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.732394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.732394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.732477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.732964] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.239201] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.239628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.239628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.239791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.239855] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.239926] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.239974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.240121] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.240206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.240739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.240739] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.240739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.240739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.240739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.241075] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.241394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.241499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.241807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.241807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.241920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.241961] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.564174] env[69637]: INFO networking_nsxv3.common.synchronization [None req-7da4ca14-63e8-4378-8997-ceb8cfc931bc None None] Enqueued Resource ID: e14924b8-aa29-4649-b285-4cd918251e7d with Priority: HIGHEST for action port [ 818.564174] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e14924b8-aa29-4649-b285-4cd918251e7d with Priority: HIGHEST for action port [ 818.564174] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-e14924b8-aa29-4649-b285-4cd918251e7d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.564174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e14924b8-aa29-4649-b285-4cd918251e7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.564174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e14924b8-aa29-4649-b285-4cd918251e7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.569416] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e14924b8-aa29-4649-b285-4cd918251e7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.569741] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e14924b8-aa29-4649-b285-4cd918251e7d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.744230] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 156f33af-1675-4f7d-b99d-9e88f58f4cd2: rpc.has_security_group_logging(os_id): False [ 818.764808] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.764949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.765035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.765241] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.765327] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.765508] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.765603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.765664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.765808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.766126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.766323] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.766414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.766474] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.766616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.766686] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.766857] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.766941] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.766999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.767146] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.767215] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.767295] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be created. [ 818.824949] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.824949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.824949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.824949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.824949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.834539] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 819.072732] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e14924b8-aa29-4649-b285-4cd918251e7d [ 819.073458] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.073458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.073458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.073458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.074053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.074053] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e14924b8-aa29-4649-b285-4cd918251e7d already deleted. [ 819.074053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e14924b8-aa29-4649-b285-4cd918251e7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.120601] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: SUCCESS [ 819.120869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.347030] env[69637]: INFO networking_nsxv3.common.synchronization [req-9c323a5f-3d00-4b55-beff-88ef6cb2823f req-c094e29c-8e91-44e9-9077-c413018d7c4e tempest-MigrationsAdminTest-855510084 tempest-MigrationsAdminTest-855510084-project-member] Enqueued Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_members [ 819.347501] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_members [ 819.347803] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.347915] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.347984] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.348188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.348338] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.348442] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.348501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.348644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.348810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.348810] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.453786] env[69637]: INFO networking_nsxv3.common.synchronization [req-db31a8b2-e85b-4dda-a7ab-3eced07cb78a req-77f2971a-7ae7-4570-bd88-c968ee202d06 tempest-ServerMetadataNegativeTestJSON-881689973 tempest-ServerMetadataNegativeTestJSON-881689973-project-member] Enqueued Resource ID: 5113e882-e54a-4682-8961-555e92283cef with Priority: HIGHEST for action security_group_members [ 819.454730] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5113e882-e54a-4682-8961-555e92283cef with Priority: HIGHEST for action security_group_members [ 819.455101] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5113e882-e54a-4682-8961-555e92283cef taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.455341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.455341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.455622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.455699] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.455766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.455827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.456113] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.456113] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.456221] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5113e882-e54a-4682-8961-555e92283cef',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.622856] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 819.622856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.622856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.622856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.622856] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.622856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.622856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.622856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.623332] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.623332] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.623332] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.623332] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.623332] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.623530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.623569] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.623647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.623705] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.623837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.623919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.626078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.626280] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.686826] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 in Status: SUCCESS [ 819.687019] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 deletion is rescheduled due to dependency. [ 819.687509] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.841161] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.841557] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.841680] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.842014] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.842731] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.844718] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.844718] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.844718] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.844718] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.844718] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.844718] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.844718] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.844718] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.844718] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.844718] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.844718] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.852393] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.863480] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.863658] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 819.863797] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.863983] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.864400] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-75202176-c47b-4660-b92a-8130704f1b84 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.864572] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-75202176-c47b-4660-b92a-8130704f1b84" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.864685] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-75202176-c47b-4660-b92a-8130704f1b84" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.865033] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-75202176-c47b-4660-b92a-8130704f1b84" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.865191] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75202176-c47b-4660-b92a-8130704f1b84',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.961950] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.962482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.962708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.963188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.963461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.963919] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.964388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.964609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.965024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.965303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.965755] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5113e882-e54a-4682-8961-555e92283cef is going to be updated. [ 819.994071] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.996470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.996470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.996470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.996470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.005993] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5113e882-e54a-4682-8961-555e92283cef in Status: IN_PROGRESS for 2s [ 820.128569] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ce64dc8-7267-4039-bf03-bb3eb50298ae: rpc.has_security_group_logging(os_id): False [ 820.147355] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.147506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.147577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.147791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.147968] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.148280] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.148449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.148516] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.148713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.149064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.149259] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.149472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.149538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.149692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.149772] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.149955] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.150064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.150141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.150358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.150470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.150567] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be updated. [ 820.222312] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.222502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.222746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.224831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.224831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.309888] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 820.355415] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.370729] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.370729] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.370729] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.370729] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.370729] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.370729] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 75202176-c47b-4660-b92a-8130704f1b84 not found, creating... [ 820.370729] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.370729] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.370729] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.370729] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.370729] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.371281] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.371281] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.371281] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.371281] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.371281] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.371281] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 75202176-c47b-4660-b92a-8130704f1b84 is going to be created. [ 820.395204] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.395204] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.395204] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.395204] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.395204] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.395204] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-75202176-c47b-4660-b92a-8130704f1b84" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.845240] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 820.845479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.864234] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.864234] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.864234] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.864234] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.864234] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.864234] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 is going to be updated. [ 820.889169] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.889309] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.889479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.889668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.889809] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.899564] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: IN_PROGRESS for 2s [ 821.143692] env[69637]: INFO networking_nsxv3.common.synchronization [req-9c323a5f-3d00-4b55-beff-88ef6cb2823f req-e6b1a135-b607-45d4-b6ac-aeb42d7c2a37 service nova] Enqueued Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_rules [ 821.143692] env[69637]: INFO networking_nsxv3.common.synchronization [req-9c323a5f-3d00-4b55-beff-88ef6cb2823f req-e6b1a135-b607-45d4-b6ac-aeb42d7c2a37 service nova] Enqueued Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_members [ 821.143692] env[69637]: INFO networking_nsxv3.common.synchronization [req-9c323a5f-3d00-4b55-beff-88ef6cb2823f req-e6b1a135-b607-45d4-b6ac-aeb42d7c2a37 service nova] Enqueued Resource ID: 75202176-c47b-4660-b92a-8130704f1b84 with Priority: HIGHEST for action port [ 821.144555] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_rules [ 821.144555] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_members [ 821.145634] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75202176-c47b-4660-b92a-8130704f1b84 with Priority: HIGHEST for action port [ 821.145634] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.145634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.145634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.145634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.145634] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.146440] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.146440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.146528] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-75202176-c47b-4660-b92a-8130704f1b84 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.146755] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75202176-c47b-4660-b92a-8130704f1b84" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.146755] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75202176-c47b-4660-b92a-8130704f1b84" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.146902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75202176-c47b-4660-b92a-8130704f1b84" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.146902] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75202176-c47b-4660-b92a-8130704f1b84',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.465501] env[69637]: INFO networking_nsxv3.common.synchronization [None req-7e29f38d-58f6-40b3-ae50-d802e1d81827 None None] Enqueued Resource ID: c2ccb80b-8f41-4f26-9ac6-0654f1826eda with Priority: HIGHEST for action port [ 821.465725] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2ccb80b-8f41-4f26-9ac6-0654f1826eda with Priority: HIGHEST for action port [ 821.467021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2ccb80b-8f41-4f26-9ac6-0654f1826eda taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.467021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2ccb80b-8f41-4f26-9ac6-0654f1826eda" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.467021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2ccb80b-8f41-4f26-9ac6-0654f1826eda" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.467021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2ccb80b-8f41-4f26-9ac6-0654f1826eda" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.467021] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2ccb80b-8f41-4f26-9ac6-0654f1826eda',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.648900] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.649104] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.652858] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75202176-c47b-4660-b92a-8130704f1b84 with status ACTIVE [ 821.652858] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.652858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.652858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.653167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.653167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.653395] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.653541] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.654634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.654634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.654634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.654634] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.654634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.654634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.654634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.654634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.654634] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75202176-c47b-4660-b92a-8130704f1b84 is going to be updated. [ 821.676206] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.676646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.676646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.676646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.676765] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.677043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75202176-c47b-4660-b92a-8130704f1b84" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.969454] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2ccb80b-8f41-4f26-9ac6-0654f1826eda [ 821.969761] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.969939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.970049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.970317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.970441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.970563] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2ccb80b-8f41-4f26-9ac6-0654f1826eda already deleted. [ 821.970671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2ccb80b-8f41-4f26-9ac6-0654f1826eda" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.993032] env[69637]: INFO networking_nsxv3.common.synchronization [req-7bc31e59-9317-4b56-9e7b-4f59b9f88373 req-195c1e18-cad3-43b1-9cce-4158a2c546ed tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 822.000703] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 822.000703] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.000703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.000703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.000703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.000703] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.000703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.000703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.000703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.000703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.000703] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.020799] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5113e882-e54a-4682-8961-555e92283cef in Status: SUCCESS [ 822.020799] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5113e882-e54a-4682-8961-555e92283cef deletion is rescheduled due to dependency. [ 822.020799] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5113e882-e54a-4682-8961-555e92283cef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.326433] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 822.326669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.326852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.327090] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.327184] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.502822] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.547625] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-682 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.547824] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-682" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.547976] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-682" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.548274] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-682" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.548684] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.548855] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.549073] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.549381] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.549889] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.549956] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.550141] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.550339] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.550536] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.550747] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.551062] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.551441] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.593976] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.594168] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 822.594309] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.594486] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-682" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.594798] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-12ef32f4-0ec6-49d3-b916-b716b6764c0b taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.594972] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.595114] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.595459] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.595600] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12ef32f4-0ec6-49d3-b916-b716b6764c0b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.829841] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.830014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.830174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.830415] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.830619] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.830750] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.830833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.831017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.831142] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.831261] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.831374] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.909936] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: SUCCESS [ 822.910257] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.910425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.910626] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.910805] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.910935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.911256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.911256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.911256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.911337] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.005387] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.099050] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.099050] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.099050] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.099298] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.099298] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.099489] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 12ef32f4-0ec6-49d3-b916-b716b6764c0b not found, creating... [ 823.099812] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.099898] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.099976] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.100232] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.100370] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.100809] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.100809] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.101025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.101300] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.101451] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.101597] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 12ef32f4-0ec6-49d3-b916-b716b6764c0b is going to be created. [ 823.121936] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.122191] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.122367] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.122632] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.122901] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.123220] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.333783] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.333928] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.334407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.334407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.334540] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.334611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.334654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.334786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.334869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.334953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.335106] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.335191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.336132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.336132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.336132] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.336132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.336132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.336132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.336132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.336132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.336132] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.413801] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.509144] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.509442] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.509442] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.509633] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.509729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.509846] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 823.537306] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.537438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.537508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.537709] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.538017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.546132] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 823.623972] env[69637]: INFO networking_nsxv3.common.synchronization [req-8acac6ec-9f73-4f00-a5c9-5dce91ee6f4f req-74f1240b-d551-453c-9e99-fdf92aee9528 tempest-ServersTestMultiNic-1929872957 tempest-ServersTestMultiNic-1929872957-project-member] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 823.624469] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 823.624788] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.624916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.624985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.625305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.625429] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.625554] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.625634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.625789] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.625888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.625991] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.839572] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ce64dc8-7267-4039-bf03-bb3eb50298ae: rpc.has_security_group_logging(os_id): False [ 823.857585] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.857739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.857844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.858188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.858269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.858446] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.858557] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.858626] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.858788] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.858867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.859064] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.859167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.859257] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.859436] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.859516] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.859701] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.859813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.859879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.862091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.862183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.862301] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be updated. [ 823.917010] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.938604] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.938751] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.938822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.939042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.939190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.958932] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 824.033323] env[69637]: INFO networking_nsxv3.common.synchronization [req-8acac6ec-9f73-4f00-a5c9-5dce91ee6f4f req-f5402cf4-5199-4e30-8748-1b04c13a54bd tempest-ServersTestMultiNic-1929872957 tempest-ServersTestMultiNic-1929872957-project-member] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 824.033837] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGHEST for action security_group_members [ 824.034260] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.034362] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.046023] env[69637]: INFO networking_nsxv3.common.synchronization [req-7bc31e59-9317-4b56-9e7b-4f59b9f88373 req-f85cbe40-dbe2-465c-97cf-a1e2e691c6e5 service nova] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_rules [ 824.046023] env[69637]: INFO networking_nsxv3.common.synchronization [req-7bc31e59-9317-4b56-9e7b-4f59b9f88373 req-f85cbe40-dbe2-465c-97cf-a1e2e691c6e5 service nova] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 824.046023] env[69637]: INFO networking_nsxv3.common.synchronization [req-7bc31e59-9317-4b56-9e7b-4f59b9f88373 req-f85cbe40-dbe2-465c-97cf-a1e2e691c6e5 service nova] Enqueued Resource ID: 12ef32f4-0ec6-49d3-b916-b716b6764c0b with Priority: HIGHEST for action port [ 824.046023] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_rules [ 824.046023] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 824.046023] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12ef32f4-0ec6-49d3-b916-b716b6764c0b with Priority: HIGHEST for action port [ 824.046023] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.046023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.046023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.046023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.046023] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.046553] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.046553] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.047850] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-12ef32f4-0ec6-49d3-b916-b716b6764c0b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.047980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.048063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.048684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.048684] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12ef32f4-0ec6-49d3-b916-b716b6764c0b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.127977] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.419024] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.419191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.419260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.419733] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.419825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.419921] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 is going to be updated. [ 824.446469] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.446623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.446798] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.447042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.447523] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.455842] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: IN_PROGRESS for 2s [ 824.549641] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.549948] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.549983] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12ef32f4-0ec6-49d3-b916-b716b6764c0b with status ACTIVE [ 824.550156] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.550278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.550355] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.550555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.550644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.550811] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.550899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.550965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.551126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.551204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.551408] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.551503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.551567] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.551706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.551782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.551866] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12ef32f4-0ec6-49d3-b916-b716b6764c0b is going to be updated. [ 824.571502] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.571646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.571716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.571918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.572062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.572250] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.630966] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.681076] env[69637]: INFO networking_nsxv3.common.synchronization [req-8b378fd3-f603-44c7-aac8-49940f6c60e4 req-d9d82de9-aa46-482a-aa74-adc246879775 tempest-ImagesTestJSON-1924392618 tempest-ImagesTestJSON-1924392618-project-member] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 824.681653] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 824.681963] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.682101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.682384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.682384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.682949] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.683185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.683293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.683502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.683766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.683929] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.078725] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.079008] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.079071] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.079335] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.079790] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.079790] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.079919] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.080297] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.080297] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.080412] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.080502] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.080705] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.080705] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.080809] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.080911] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.081132] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.100215] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.100215] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 825.100215] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.100215] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.100215] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-8ffe6d39-5931-4f4a-9a03-069c88257864 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.100215] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-8ffe6d39-5931-4f4a-9a03-069c88257864" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.100215] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-8ffe6d39-5931-4f4a-9a03-069c88257864" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.100215] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-8ffe6d39-5931-4f4a-9a03-069c88257864" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.100604] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ffe6d39-5931-4f4a-9a03-069c88257864',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.133801] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.133950] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.134029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.134234] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.134323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.134439] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be updated. [ 825.160130] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.160278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.160363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.160559] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.160698] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.168144] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 825.193028] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.193028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.193028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.193028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.193028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.193028] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.193028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.193028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.193028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.193028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.193028] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 825.222060] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.222060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.222060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.222060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.222060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.238989] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 825.557867] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 825.558216] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.558278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.558556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.558781] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.558954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.559042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.559270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.559402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.559519] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.603414] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.603414] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.603414] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.603849] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.604012] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.604277] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 8ffe6d39-5931-4f4a-9a03-069c88257864 not found, creating... [ 825.604636] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.604890] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.605021] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.605320] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.605538] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.605879] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.606166] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.606214] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.606459] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.606597] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.606878] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 8ffe6d39-5931-4f4a-9a03-069c88257864 is going to be created. [ 825.626621] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.626621] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.626886] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.627214] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.627576] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.628700] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-8ffe6d39-5931-4f4a-9a03-069c88257864" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.974766] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 825.975018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.061773] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.466594] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: SUCCESS [ 826.466850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.467132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.467303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.468144] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.468293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.468373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.468560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.468647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.468736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.468829] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.509409] env[69637]: INFO networking_nsxv3.common.synchronization [req-8b378fd3-f603-44c7-aac8-49940f6c60e4 req-79ecdc6e-3297-4d39-9e0d-e8becac39597 service nova] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_rules [ 826.509706] env[69637]: INFO networking_nsxv3.common.synchronization [req-8b378fd3-f603-44c7-aac8-49940f6c60e4 req-79ecdc6e-3297-4d39-9e0d-e8becac39597 service nova] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 826.509869] env[69637]: INFO networking_nsxv3.common.synchronization [req-8b378fd3-f603-44c7-aac8-49940f6c60e4 req-79ecdc6e-3297-4d39-9e0d-e8becac39597 service nova] Enqueued Resource ID: 8ffe6d39-5931-4f4a-9a03-069c88257864 with Priority: HIGHEST for action port [ 826.510369] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_rules [ 826.510504] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 826.510823] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ffe6d39-5931-4f4a-9a03-069c88257864 with Priority: HIGHEST for action port [ 826.510890] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.510988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.511363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.511576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.511661] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.513428] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.513533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.514862] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ffe6d39-5931-4f4a-9a03-069c88257864 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.514862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ffe6d39-5931-4f4a-9a03-069c88257864" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.514862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ffe6d39-5931-4f4a-9a03-069c88257864" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.514862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ffe6d39-5931-4f4a-9a03-069c88257864" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.514862] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ffe6d39-5931-4f4a-9a03-069c88257864',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.564527] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.973135] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.973341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.973390] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.973581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.973750] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.973842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.973902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.974062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.974151] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.974239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.974385] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.974477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.974547] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.974675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.974810] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.974899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.974958] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.975105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.975182] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.975259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.975351] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.013785] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.013976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.018668] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ffe6d39-5931-4f4a-9a03-069c88257864 with status ACTIVE [ 827.018867] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.018988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.019077] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.019287] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.019379] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.019552] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.019666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.019697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.019842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.019938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.020101] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.020195] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.020256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.020388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.020542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.020542] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ffe6d39-5931-4f4a-9a03-069c88257864 is going to be updated. [ 827.042842] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.042842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.042842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.042842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.042842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.042842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ffe6d39-5931-4f4a-9a03-069c88257864" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.068911] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.068911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.069179] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.069179] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.069273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.069368] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 827.103272] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.103421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.103511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.103689] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.103825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.114155] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 827.188189] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 827.188438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.188638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.188889] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.189118] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.189240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.189308] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.189464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.189545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.189638] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.251582] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 827.251810] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 deletion is rescheduled due to dependency. [ 827.251956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.252189] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.252457] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.252683] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.252833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.252921] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.253176] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.253278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.253404] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.478420] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bff14a3b-698b-4fee-8b4e-d724ef23de40: rpc.has_security_group_logging(os_id): False [ 827.498076] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.498236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.498317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.498530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.498620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.498814] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.498909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.498969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.499121] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.499251] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.499442] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.499536] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.499598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.499738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.499813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.500012] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.500171] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.500234] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.500375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.500451] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.500535] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 is going to be updated. [ 827.562748] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.563011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.563116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.563339] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.563486] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.584502] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: IN_PROGRESS for 2s [ 827.691853] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.691970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.692053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.692285] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.692375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.692701] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.692852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.693107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.693663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.693802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.693928] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be updated. [ 827.734823] env[69637]: INFO networking_nsxv3.common.synchronization [req-ea6b8dfc-9fc3-4c2d-a874-3cc87145e052 req-9d52fd17-c577-4b00-abc2-714eeeea9744 tempest-VolumesAssistedSnapshotsTest-1383698631 tempest-VolumesAssistedSnapshotsTest-1383698631-project-member] Enqueued Resource ID: 67b79615-8ab9-4c90-bd99-6702f487431a with Priority: HIGHEST for action security_group_members [ 827.735460] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b79615-8ab9-4c90-bd99-6702f487431a with Priority: HIGHEST for action security_group_members [ 827.736117] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-67b79615-8ab9-4c90-bd99-6702f487431a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.736117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.736117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.736402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.736457] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.736539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.737624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.737821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.737909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.738016] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67b79615-8ab9-4c90-bd99-6702f487431a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.742224] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.742224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.742224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.742224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.742224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.752428] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: IN_PROGRESS for 2s [ 827.756762] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.245690] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.245827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.245952] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.246137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.246223] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.247500] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.247500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.247500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.247500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.247500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.247500] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67b79615-8ab9-4c90-bd99-6702f487431a is going to be updated. [ 828.258499] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.281662] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.281805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.281892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.282176] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.282328] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.292229] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67b79615-8ab9-4c90-bd99-6702f487431a in Status: IN_PROGRESS for 2s [ 828.705063] env[69637]: INFO networking_nsxv3.common.synchronization [req-8a480b0b-3b65-44bc-b8bb-f81f7183aae4 req-a4bf513d-7cdd-4ce7-af87-4e0e48d2889f tempest-ListImageFiltersTestJSON-1967239197 tempest-ListImageFiltersTestJSON-1967239197-project-member] Enqueued Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_members [ 828.707761] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed080368-c954-48e2-a0f1-c55ff7a728fd with Priority: HIGHEST for action security_group_members [ 828.707761] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed080368-c954-48e2-a0f1-c55ff7a728fd taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.707761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.707761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.707761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.707761] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.707761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.707761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.707761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.707761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.707761] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed080368-c954-48e2-a0f1-c55ff7a728fd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.761301] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.761426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.761503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.761958] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.762088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.762220] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 828.793674] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.793914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.793992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.794294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.794412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.804066] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 829.124902] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 829.125160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.125333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.125550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.125736] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.125856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.125917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.126097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.126190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.126275] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.126369] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.210227] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.210227] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.210425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.210516] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.210691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.210941] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.211134] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.211208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.211530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.211530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.211673] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed080368-c954-48e2-a0f1-c55ff7a728fd is going to be updated. [ 829.248170] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.248334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.248381] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.248584] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.248721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.258520] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed080368-c954-48e2-a0f1-c55ff7a728fd in Status: IN_PROGRESS for 2s [ 829.599880] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: SUCCESS [ 829.600144] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.628935] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.629109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.629180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.629401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.629602] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.629657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.629727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.629872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.629956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.630061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.630209] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.630300] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.630360] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.630546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.630683] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.630778] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.630839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.630977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.631113] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.631205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.631296] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.763200] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae in Status: SUCCESS [ 829.763517] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae deletion is rescheduled due to dependency. [ 829.763713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.136173] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1db16c79-2ca0-4113-99b1-64acc68fd18a: rpc.has_security_group_logging(os_id): False [ 830.153040] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.153343] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.153422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.153655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.153829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.154091] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.154170] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.154205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.154352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.154500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.154702] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.154800] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.155067] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.155067] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.155067] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.155256] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.155348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.155422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.155590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.155663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.155743] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 830.222181] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.222376] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.222446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.222665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.222810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.262620] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 830.301966] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67b79615-8ab9-4c90-bd99-6702f487431a in Status: SUCCESS [ 830.301966] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67b79615-8ab9-4c90-bd99-6702f487431a deletion is rescheduled due to dependency. [ 830.301966] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.812695] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 830.813185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.813230] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.813483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.813716] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.813880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.813994] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.814203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.814364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.814542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.814675] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.110795] env[69637]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 831.110795] env[69637]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] NSXv3 Agent Agent loop - iteration:1 started [ 831.268186] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed080368-c954-48e2-a0f1-c55ff7a728fd in Status: SUCCESS [ 831.268369] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed080368-c954-48e2-a0f1-c55ff7a728fd deletion is rescheduled due to dependency. [ 831.268485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed080368-c954-48e2-a0f1-c55ff7a728fd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.317123] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.317443] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.317443] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.317567] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.317731] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.317834] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.317896] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.318066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.318153] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.318242] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.318384] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.318471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.318531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.318669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.318802] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.318888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.318948] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.319095] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.319167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.319267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.319386] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.821345] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc8c512a-6092-4e87-9d42-efdd0a8ab3f4: rpc.has_security_group_logging(os_id): False [ 831.838248] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.838399] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.838495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.838741] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.838869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.841322] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.841322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.841322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.841322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.841322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.841322] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.841322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.841322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.841322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.841322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.841322] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.841322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.841322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.841322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.841895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.841895] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 831.898303] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.898458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.898511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.898719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.898862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.911315] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 832.277027] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 832.277109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.470074] env[69637]: INFO networking_nsxv3.common.synchronization [req-960b8c52-6002-42f1-8325-4d1f432c7b21 req-5382aa3e-f65f-48a3-a262-2b30ba6b840b tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e with Priority: HIGHEST for action security_group_members [ 833.470341] env[69637]: INFO networking_nsxv3.common.synchronization [req-960b8c52-6002-42f1-8325-4d1f432c7b21 req-5382aa3e-f65f-48a3-a262-2b30ba6b840b tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 833.470802] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e with Priority: HIGHEST for action security_group_members [ 833.470896] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 833.471258] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0475f73c-bd08-4252-a0b4-0d5eada8263e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.471396] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.471462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.471875] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.472132] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.472229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.472317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.472552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.472710] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.472871] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0475f73c-bd08-4252-a0b4-0d5eada8263e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.474033] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.474033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.474033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.474265] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.476206] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.476206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.476206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.476206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.476206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.476206] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.525295] env[69637]: INFO networking_nsxv3.common.synchronization [req-960b8c52-6002-42f1-8325-4d1f432c7b21 req-5382aa3e-f65f-48a3-a262-2b30ba6b840b tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e with Priority: HIGHEST for action security_group_rules [ 833.525481] env[69637]: INFO networking_nsxv3.common.synchronization [req-960b8c52-6002-42f1-8325-4d1f432c7b21 req-5382aa3e-f65f-48a3-a262-2b30ba6b840b tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e with Priority: HIGHEST for action security_group_members [ 833.525652] env[69637]: INFO networking_nsxv3.common.synchronization [req-960b8c52-6002-42f1-8325-4d1f432c7b21 req-5382aa3e-f65f-48a3-a262-2b30ba6b840b tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_rules [ 833.525806] env[69637]: INFO networking_nsxv3.common.synchronization [req-960b8c52-6002-42f1-8325-4d1f432c7b21 req-5382aa3e-f65f-48a3-a262-2b30ba6b840b tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 833.525939] env[69637]: INFO networking_nsxv3.common.synchronization [req-960b8c52-6002-42f1-8325-4d1f432c7b21 req-5382aa3e-f65f-48a3-a262-2b30ba6b840b tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 12ef32f4-0ec6-49d3-b916-b716b6764c0b with Priority: HIGHEST for action port [ 833.526423] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e with Priority: HIGHEST for action security_group_rules [ 833.526559] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_rules [ 833.526658] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12ef32f4-0ec6-49d3-b916-b716b6764c0b with Priority: HIGHEST for action port [ 833.526751] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e with Priority: HIGHEST for action security_group_members [ 833.526841] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 833.527292] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0475f73c-bd08-4252-a0b4-0d5eada8263e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.527462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.527558] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.527840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.528284] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0475f73c-bd08-4252-a0b4-0d5eada8263e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.528843] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.528990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.529098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.529310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.529419] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.530168] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-12ef32f4-0ec6-49d3-b916-b716b6764c0b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.530600] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.530600] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.530600] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.530600] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12ef32f4-0ec6-49d3-b916-b716b6764c0b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.531645] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0475f73c-bd08-4252-a0b4-0d5eada8263e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.531786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.532068] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.532205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.927296] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 833.927296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.977512] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0475f73c-bd08-4252-a0b4-0d5eada8263e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.979713] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.034412] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0475f73c-bd08-4252-a0b4-0d5eada8263e taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.034412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.034412] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12ef32f4-0ec6-49d3-b916-b716b6764c0b with status ACTIVE [ 834.034412] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.034412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.034412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.034735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.034735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.034876] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.034921] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.034950] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.035107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.035177] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.035356] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.035444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.035503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.035821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.035897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.035979] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12ef32f4-0ec6-49d3-b916-b716b6764c0b is going to be updated. [ 834.037552] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.037680] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.057843] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.057843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.057843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.057843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.057843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.057843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.480152] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0475f73c-bd08-4252-a0b4-0d5eada8263e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.481097] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.983455] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.984074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.984074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.984074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.984074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.984235] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e is going to be created. [ 834.985521] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.985636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.985714] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.985889] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.985966] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.986079] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 835.007851] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.007851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.007851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.007973] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.008223] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.010350] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.010350] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.010350] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.010492] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.010655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.020542] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 835.021206] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e in Status: UNINITIALIZED for 2s [ 835.068797] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.068954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.069286] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.069286] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.069377] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.572797] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.075358] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.474019] env[69637]: INFO networking_nsxv3.common.synchronization [req-75d9be38-4dd2-455f-89f8-f64bbb2e8fbe req-4fd608a4-35c8-44ed-8a74-d77cfb5ea22b tempest-ServerDiskConfigTestJSON-538739594 tempest-ServerDiskConfigTestJSON-538739594-project-member] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 836.474019] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 836.474261] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.474403] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.474472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.474671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.474816] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.474919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.474966] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.476885] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.477646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.477977] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.576939] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 836.577215] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 836.809109] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-185 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.809340] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.809467] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.809739] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.809979] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.810138] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.811783] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.811783] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.811783] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.811783] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.811783] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.811981] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.811981] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.812052] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.812132] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.812264] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.835744] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.835744] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 836.835744] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.835744] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.835744] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-0ecafe6e-9996-4248-94ed-218b21b29155 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.835744] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-0ecafe6e-9996-4248-94ed-218b21b29155" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.835744] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-0ecafe6e-9996-4248-94ed-218b21b29155" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.835744] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-0ecafe6e-9996-4248-94ed-218b21b29155" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.835744] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ecafe6e-9996-4248-94ed-218b21b29155',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.982257] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.982445] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.982724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.982957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.983069] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.983251] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.983371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.983436] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.983587] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.983665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.983749] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 837.009890] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.010044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.010116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.010306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.010488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.018441] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 837.029046] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 837.029046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.029168] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.029331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.030273] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.030273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.030273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.030273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.030273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.030273] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.031381] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e in Status: SUCCESS [ 837.031597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.031742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.031906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.032072] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.032176] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.032242] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.032386] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.032464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.032556] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0475f73c-bd08-4252-a0b4-0d5eada8263e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.337108] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.337339] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.337468] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.337738] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.337885] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.338054] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 0ecafe6e-9996-4248-94ed-218b21b29155 not found, creating... [ 837.338311] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.338465] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.338579] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.338815] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.338950] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.339235] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.339395] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.339509] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.339709] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.339837] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.339970] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 0ecafe6e-9996-4248-94ed-218b21b29155 is going to be created. [ 837.355894] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.356057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.356113] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.356272] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.367900] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 837.370254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.370968] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 837.373240] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.373240] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.373240] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.373445] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.373549] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.373767] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-0ecafe6e-9996-4248-94ed-218b21b29155" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.507656] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.507812] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.507936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.508191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.515631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.516158] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 837.516241] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 837.516337] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 837.534185] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.535105] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0475f73c-bd08-4252-a0b4-0d5eada8263e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.569506] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.569506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.569506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.569649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.570898] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.571095] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 837.636371] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.636657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.636657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.636809] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.637035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.637246] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 837.720066] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.720283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.720367] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.720609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.720851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.721374] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:32. [ 837.721374] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'645e75b0-47c9-44b7-81c7-713e50cf04dc', '9d67e668-2cd0-4b57-ba21-01962274ede2', '63016cee-78e5-471f-804a-ad9bcf1b801a', 'c162e9c6-1558-4a4a-82d6-88bff0e93b92', 'ad77a84e-935d-4f36-9c82-e497b2b9c639', '6b419c77-3987-4359-99fb-b76e7165ba63', 'dc8c512a-6092-4e87-9d42-efdd0a8ab3f4', 'bac27816-ae12-436b-86da-6c4bbde7b2ac', 'ab904195-351a-49c6-8462-7f952d95cf87', '1db16c79-2ca0-4113-99b1-64acc68fd18a', 'e2bf78cc-b175-4724-9f7a-27b142d3a998', '1ce64dc8-7267-4039-bf03-bb3eb50298ae', 'bff14a3b-698b-4fee-8b4e-d724ef23de40', '71aadb5f-78e6-44ce-b947-3707467a678d', 'c2ec22d1-47af-4b01-875c-6ea44a1abaa3', '5fb52e9e-114d-48d5-9b9e-c3f299243e92', '9ebf57d6-6da5-49a3-83b3-8e08d42464db', '552e4f46-9b42-4666-9223-428ed3c3368c', '2e7e0a9c-c4a7-4666-a3e3-3138a89446e5', '73fa4a6e-8adc-47da-9b8e-35f70f60c275', '77e45333-e861-4952-94f1-dfd9a9a2ed58', '156f33af-1675-4f7d-b99d-9e88f58f4cd2', '2bea8a67-35df-45be-bf57-95c80494d7fe', '67b79615-8ab9-4c90-bd99-6702f487431a', '2f55a00f-c3f8-407e-be41-257b4c01874f', '69c7681d-644f-47c6-8228-9fc17f49b5a3', '9d9cb429-99aa-4837-be4a-8fc93149f9fb', 'fb173e06-7b41-4fdf-ae0b-3bb378905a07', 'ed080368-c954-48e2-a0f1-c55ff7a728fd', '5113e882-e54a-4682-8961-555e92283cef', 'fefafe98-8990-454a-a252-19be0a2a5042', 'ff9b407c-6313-458e-a95d-b00d9b8914d1'} {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 837.721374] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 837.749405] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.749571] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.749688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.749845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.749933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.750073] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 837.750149] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 837.750224] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 837.824985] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.825171] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.825209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.825419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.826071] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.826283] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 837.826369] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 837.826443] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 837.826509] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 837.826585] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/32 resources of Type:Security Group Rules [ 837.826717] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGH for action security_group_rules [ 837.826761] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 with Priority: HIGH for action security_group_rules [ 837.827652] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGH for action security_group_rules [ 837.827652] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGH for action security_group_rules [ 837.827652] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGH for action security_group_rules [ 837.827652] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGH for action security_group_rules [ 837.827652] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGH for action security_group_rules [ 837.827652] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGH for action security_group_rules [ 837.827652] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGH for action security_group_rules [ 837.827652] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGH for action security_group_rules [ 837.827652] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 with Priority: HIGH for action security_group_rules [ 837.827652] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGH for action security_group_rules [ 837.827652] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGH for action security_group_rules [ 837.827652] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 71aadb5f-78e6-44ce-b947-3707467a678d with Priority: HIGH for action security_group_rules [ 837.827652] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 with Priority: HIGH for action security_group_rules [ 837.827652] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGH for action security_group_rules [ 837.827652] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGH for action security_group_rules [ 837.828132] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGH for action security_group_rules [ 837.828132] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 with Priority: HIGH for action security_group_rules [ 837.828132] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGH for action security_group_rules [ 837.828132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.036924] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.037867] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0475f73c-bd08-4252-a0b4-0d5eada8263e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.135462] env[69637]: INFO networking_nsxv3.common.synchronization [req-75d9be38-4dd2-455f-89f8-f64bbb2e8fbe req-962c8380-68aa-426b-99a6-c3a1d1316aac service nova] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_rules [ 838.135462] env[69637]: INFO networking_nsxv3.common.synchronization [req-75d9be38-4dd2-455f-89f8-f64bbb2e8fbe req-962c8380-68aa-426b-99a6-c3a1d1316aac service nova] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 838.135462] env[69637]: INFO networking_nsxv3.common.synchronization [req-75d9be38-4dd2-455f-89f8-f64bbb2e8fbe req-962c8380-68aa-426b-99a6-c3a1d1316aac service nova] Enqueued Resource ID: 0ecafe6e-9996-4248-94ed-218b21b29155 with Priority: HIGHEST for action port [ 838.136965] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_rules [ 838.137146] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 838.137232] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ecafe6e-9996-4248-94ed-218b21b29155 with Priority: HIGHEST for action port [ 838.137330] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc with Priority: HIGH for action security_group_rules [ 838.137422] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63016cee-78e5-471f-804a-ad9bcf1b801a with Priority: HIGH for action security_group_rules [ 838.137512] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGH for action security_group_rules [ 838.137598] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 with Priority: HIGH for action security_group_rules [ 838.137683] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 with Priority: HIGH for action security_group_rules [ 838.137767] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 with Priority: HIGH for action security_group_rules [ 838.137850] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552e4f46-9b42-4666-9223-428ed3c3368c with Priority: HIGH for action security_group_rules [ 838.137933] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGH for action security_group_rules [ 838.138028] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aadb5f-78e6-44ce-b947-3707467a678d with Priority: HIGH for action security_group_rules [ 838.139077] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGH for action security_group_rules [ 838.139077] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGH for action security_group_rules [ 838.139077] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae with Priority: HIGH for action security_group_rules [ 838.139077] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 with Priority: HIGH for action security_group_rules [ 838.139077] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGH for action security_group_rules [ 838.139077] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGH for action security_group_rules [ 838.139077] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGH for action security_group_rules [ 838.139077] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGH for action security_group_rules [ 838.139077] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGH for action security_group_rules [ 838.139077] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 with Priority: HIGH for action security_group_rules [ 838.139077] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 with Priority: HIGH for action security_group_rules [ 838.139691] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.139691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.139691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.139834] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.140179] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.140922] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.141033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.141229] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ecafe6e-9996-4248-94ed-218b21b29155 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.141333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ecafe6e-9996-4248-94ed-218b21b29155" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.141382] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ecafe6e-9996-4248-94ed-218b21b29155" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.141551] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ecafe6e-9996-4248-94ed-218b21b29155" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.141631] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ecafe6e-9996-4248-94ed-218b21b29155',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.142536] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-645e75b0-47c9-44b7-81c7-713e50cf04dc taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.142645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.142969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.143087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.143170] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('645e75b0-47c9-44b7-81c7-713e50cf04dc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.143906] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63016cee-78e5-471f-804a-ad9bcf1b801a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.144010] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.144090] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.144273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.144330] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63016cee-78e5-471f-804a-ad9bcf1b801a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.145311] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.145311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.145311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.145455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.145455] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.146661] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2ec22d1-47af-4b01-875c-6ea44a1abaa3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.146790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.146842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.147143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.147243] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2ec22d1-47af-4b01-875c-6ea44a1abaa3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.148214] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73fa4a6e-8adc-47da-9b8e-35f70f60c275 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.148303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.148303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.148460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.148535] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73fa4a6e-8adc-47da-9b8e-35f70f60c275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.149340] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.149448] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.149515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.149662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.149734] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e7e0a9c-c4a7-4666-a3e3-3138a89446e5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.150686] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-552e4f46-9b42-4666-9223-428ed3c3368c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.150794] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.150860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.151014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.151089] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('552e4f46-9b42-4666-9223-428ed3c3368c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.151335] env[69637]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 838.152026] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.152125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.152179] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.152311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.152383] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ebf57d6-6da5-49a3-83b3-8e08d42464db',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.153277] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71aadb5f-78e6-44ce-b947-3707467a678d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.153408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.153475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.153627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.153703] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71aadb5f-78e6-44ce-b947-3707467a678d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.154524] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.154764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.154831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.154980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.155216] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fb52e9e-114d-48d5-9b9e-c3f299243e92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.155953] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.156270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.156270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.156270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.156270] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.157067] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.157265] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.157340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.157494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.157567] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ce64dc8-7267-4039-bf03-bb3eb50298ae',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.158362] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2bf78cc-b175-4724-9f7a-27b142d3a998 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.158470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.158535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.158684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.158753] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2bf78cc-b175-4724-9f7a-27b142d3a998',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.159669] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.159763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.159949] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.160053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.160111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.160258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.160319] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.161118] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.161221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.161279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.161429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.161503] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.162291] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.162391] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.162557] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad77a84e-935d-4f36-9c82-e497b2b9c639 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.162652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.162715] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.162863] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.162933] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.164259] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d67e668-2cd0-4b57-ba21-01962274ede2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.164368] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.164435] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.164587] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.164657] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d67e668-2cd0-4b57-ba21-01962274ede2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.164869] env[69637]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 838.165531] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.165654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.165708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.165851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.165994] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c162e9c6-1558-4a4a-82d6-88bff0e93b92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.172452] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.172556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.199838] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.199838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.199838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.199838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.219677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.219810] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 645e75b0-47c9-44b7-81c7-713e50cf04dc is going to be deleted. [ 838.272380] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.272539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.272606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.272829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.272925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.273058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-645e75b0-47c9-44b7-81c7-713e50cf04dc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.539569] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.539891] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.540085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.540338] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.540509] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.540664] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 838.542677] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.542677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.542677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.542677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.543076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.543076] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e is going to be updated. [ 838.582284] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.582421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.582563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.582731] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.582941] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.585100] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.585265] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.585365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.585597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.585809] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.595395] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e in Status: IN_PROGRESS for 2s [ 838.596046] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 838.668080] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ecafe6e-9996-4248-94ed-218b21b29155 with status ACTIVE [ 838.668477] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.668634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.668760] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.669086] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.669198] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.669385] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.669487] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.669569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.669752] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.669832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.670071] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.670202] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.670294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.670480] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.670569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.670654] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ecafe6e-9996-4248-94ed-218b21b29155 is going to be updated. [ 838.689655] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.689655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.689655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.689655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.694436] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.694539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.694608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.694775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.694894] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.695058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ecafe6e-9996-4248-94ed-218b21b29155" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.705041] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ebf57d6-6da5-49a3-83b3-8e08d42464db taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.705041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.705041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.705041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.705041] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.705041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.705041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.705041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.705041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.705041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.705041] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ebf57d6-6da5-49a3-83b3-8e08d42464db',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.705769] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad77a84e-935d-4f36-9c82-e497b2b9c639 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.705877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.705944] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.706468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.706468] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.706468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.706468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.706642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.706642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.706642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.706738] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.707527] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.707631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.707698] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.707914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.707981] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.708089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.708152] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.708288] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.708386] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.708514] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.708514] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.711927] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.712037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.712113] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.712259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.712398] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.712913] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.713214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.713214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.713214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.713372] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.713372] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.719750] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.719855] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63016cee-78e5-471f-804a-ad9bcf1b801a is going to be deleted. [ 838.723869] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fb52e9e-114d-48d5-9b9e-c3f299243e92 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.724021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.724083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.724256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.724406] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.724505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.724562] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.724708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.724788] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.724869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.724950] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fb52e9e-114d-48d5-9b9e-c3f299243e92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.727840] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.727952] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.728074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.728189] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.728333] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.728429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.728494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.728635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.729341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.729341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.729341] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.769683] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.769847] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.769914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.770177] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.771774] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.771877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.772651] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.772754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.773406] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.773506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.774576] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.774633] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.776036] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.776139] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.776725] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.776836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.778284] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.778374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.779148] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.779214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.783297] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.783427] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.787593] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.787707] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2bf78cc-b175-4724-9f7a-27b142d3a998 is going to be deleted. [ 838.788561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.788764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.813565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.813726] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d67e668-2cd0-4b57-ba21-01962274ede2 is going to be deleted. [ 838.814730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.814977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.819991] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.820117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.834664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.834664] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c162e9c6-1558-4a4a-82d6-88bff0e93b92 is going to be deleted. [ 838.835819] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.836970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.855875] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.856058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.870985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.871134] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2ec22d1-47af-4b01-875c-6ea44a1abaa3 is going to be deleted. [ 838.872360] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.872559] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.908019] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.908019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.908447] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.908544] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.910921] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.911052] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e7e0a9c-c4a7-4666-a3e3-3138a89446e5 is going to be deleted. [ 838.911901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.912116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.935958] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.936097] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71aadb5f-78e6-44ce-b947-3707467a678d is going to be deleted. [ 838.936941] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.937154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.978968] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.978968] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.000937] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.001105] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be deleted. [ 839.002020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.002235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.030960] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 839.031158] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac deletion is rescheduled due to dependency. [ 839.031270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.031492] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.031656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.031840] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.031990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.032034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.032164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.032244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.032342] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.035766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.035900] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 552e4f46-9b42-4666-9223-428ed3c3368c is going to be deleted. [ 839.036697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.036870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.096707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.096844] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73fa4a6e-8adc-47da-9b8e-35f70f60c275 is going to be deleted. [ 839.097851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.098116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.099466] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.099573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.108444] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.108536] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.142940] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.143071] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.151783] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.151880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.170762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.170762] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ce64dc8-7267-4039-bf03-bb3eb50298ae is going to be deleted. [ 839.171592] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.171800] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.171891] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.172016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63016cee-78e5-471f-804a-ad9bcf1b801a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.172176] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.172333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.172414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.172533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2bf78cc-b175-4724-9f7a-27b142d3a998" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.173452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.173614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.173701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.173816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d67e668-2cd0-4b57-ba21-01962274ede2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.173948] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.174156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.174239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.174351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c162e9c6-1558-4a4a-82d6-88bff0e93b92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.174479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.174623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.174701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.174814] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2ec22d1-47af-4b01-875c-6ea44a1abaa3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.174939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.175091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.175169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.175278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e7e0a9c-c4a7-4666-a3e3-3138a89446e5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.175399] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.175544] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.175620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.175727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71aadb5f-78e6-44ce-b947-3707467a678d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.175866] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.175993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.176083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.176187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.176395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.176580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.176679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.176786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-552e4f46-9b42-4666-9223-428ed3c3368c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.214637] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.214637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.214637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.214637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.214637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.214857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73fa4a6e-8adc-47da-9b8e-35f70f60c275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.218385] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.218385] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.218385] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.218552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.218691] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.218844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.218844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.218988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.219078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.219162] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.219305] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.219393] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.219451] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.219586] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.219723] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.219938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.219938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.220037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.220092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.220160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.220249] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.222101] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.222795] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ebf57d6-6da5-49a3-83b3-8e08d42464db',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.223500] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.223649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.223684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.223815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.223953] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.224063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.224124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.224262] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.224336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.224418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.224605] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.224705] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.224764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.224990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.225055] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.225147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.225191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.225319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.225428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.225471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.225542] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.235766] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fb52e9e-114d-48d5-9b9e-c3f299243e92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.240108] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.313237] env[69637]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 839.313851] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.313986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.314099] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.314324] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.314438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.314565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ce64dc8-7267-4039-bf03-bb3eb50298ae" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.534752] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.723178] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bff14a3b-698b-4fee-8b4e-d724ef23de40: rpc.has_security_group_logging(os_id): False [ 839.726434] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad77a84e-935d-4f36-9c82-e497b2b9c639: rpc.has_security_group_logging(os_id): False [ 839.727744] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ebf57d6-6da5-49a3-83b3-8e08d42464db: rpc.has_security_group_logging(os_id): False [ 839.730656] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc8c512a-6092-4e87-9d42-efdd0a8ab3f4: rpc.has_security_group_logging(os_id): False [ 839.739965] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fb52e9e-114d-48d5-9b9e-c3f299243e92: rpc.has_security_group_logging(os_id): False [ 839.745182] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b419c77-3987-4359-99fb-b76e7165ba63: rpc.has_security_group_logging(os_id): False [ 839.749743] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.749904] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.749974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.750212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.751917] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.752028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.752749] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.752831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.753540] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.753645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.755220] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.755220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.756552] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.756621] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.766673] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.766991] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.767093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.767093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.767270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.767351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.767543] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.767644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.767706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.767853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.768366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.768366] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.768366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.768366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.768547] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.768547] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.768547] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 is going to be updated. [ 839.773801] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.773979] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.790264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.790539] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.790642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.790712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.790912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.790980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.791093] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db is going to be updated. [ 839.792203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.792376] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.807644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.807895] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.808201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.808201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.808329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.808370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.808545] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.808623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.808687] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.808822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.808893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.809100] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.809178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.809237] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.809372] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.809446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.809534] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 839.811058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.811150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.832516] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.832942] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.833163] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.833288] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.833532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.833669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.833820] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b419c77-3987-4359-99fb-b76e7165ba63 is going to be updated. [ 839.837410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.837410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.840833] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.840833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.856552] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.856718] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.860992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.861239] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.861382] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.861446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.861642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.861734] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.861836] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 is going to be updated. [ 839.862963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.863299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.871823] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.871980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.890745] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.891074] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.891172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.891242] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.891462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.891542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.891636] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 is going to be updated. [ 839.892763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.892956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.893125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.894210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.894418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.894554] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.895420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.895578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.895710] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.931176] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db in Status: IN_PROGRESS for 2s [ 839.931902] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: IN_PROGRESS for 2s [ 839.933533] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 839.960065] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.960065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.960065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.960065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.960065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.967567] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.967703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.967766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.969819] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.969819] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.978304] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b419c77-3987-4359-99fb-b76e7165ba63 in Status: IN_PROGRESS for 2s [ 839.979892] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 in Status: IN_PROGRESS for 2s [ 840.028916] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.028916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.028916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.028916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.028916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.040266] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.050394] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: IN_PROGRESS for 2s [ 840.284224] env[69637]: INFO networking_nsxv3.common.synchronization [req-3f981fb8-a45e-4e82-a96f-67216c23dbf9 req-3a02352d-731a-412c-a972-bf2e40f947cf tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 with Priority: HIGHEST for action security_group_members [ 840.284371] env[69637]: INFO networking_nsxv3.common.synchronization [req-3f981fb8-a45e-4e82-a96f-67216c23dbf9 req-3a02352d-731a-412c-a972-bf2e40f947cf tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 840.284602] env[69637]: INFO networking_nsxv3.common.synchronization [req-3f981fb8-a45e-4e82-a96f-67216c23dbf9 req-3a02352d-731a-412c-a972-bf2e40f947cf tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e with Priority: HIGHEST for action security_group_members [ 840.285503] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 with Priority: HIGHEST for action security_group_members [ 840.286781] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 840.286781] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e with Priority: HIGHEST for action security_group_members [ 840.286781] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.286781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.286781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.287262] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.287262] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.287262] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.287262] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.287475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.287941] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.287941] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('164ae16c-e4a1-4c69-9fb1-592f45a8fea3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.289224] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.289224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.289224] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0475f73c-bd08-4252-a0b4-0d5eada8263e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.289224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.344109] env[69637]: INFO networking_nsxv3.common.synchronization [req-3f981fb8-a45e-4e82-a96f-67216c23dbf9 req-3a02352d-731a-412c-a972-bf2e40f947cf tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e with Priority: HIGHEST for action security_group_rules [ 840.345153] env[69637]: INFO networking_nsxv3.common.synchronization [req-3f981fb8-a45e-4e82-a96f-67216c23dbf9 req-3a02352d-731a-412c-a972-bf2e40f947cf tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e with Priority: HIGHEST for action security_group_members [ 840.345153] env[69637]: INFO networking_nsxv3.common.synchronization [req-3f981fb8-a45e-4e82-a96f-67216c23dbf9 req-3a02352d-731a-412c-a972-bf2e40f947cf tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 with Priority: HIGHEST for action security_group_rules [ 840.345153] env[69637]: INFO networking_nsxv3.common.synchronization [req-3f981fb8-a45e-4e82-a96f-67216c23dbf9 req-3a02352d-731a-412c-a972-bf2e40f947cf tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 with Priority: HIGHEST for action security_group_members [ 840.345153] env[69637]: INFO networking_nsxv3.common.synchronization [req-3f981fb8-a45e-4e82-a96f-67216c23dbf9 req-3a02352d-731a-412c-a972-bf2e40f947cf tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_rules [ 840.345153] env[69637]: INFO networking_nsxv3.common.synchronization [req-3f981fb8-a45e-4e82-a96f-67216c23dbf9 req-3a02352d-731a-412c-a972-bf2e40f947cf tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 840.345153] env[69637]: INFO networking_nsxv3.common.synchronization [req-3f981fb8-a45e-4e82-a96f-67216c23dbf9 req-3a02352d-731a-412c-a972-bf2e40f947cf tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 12ef32f4-0ec6-49d3-b916-b716b6764c0b with Priority: HIGHEST for action port [ 840.345505] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e with Priority: HIGHEST for action security_group_rules [ 840.345595] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 with Priority: HIGHEST for action security_group_rules [ 840.345752] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 840.346508] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12ef32f4-0ec6-49d3-b916-b716b6764c0b with Priority: HIGHEST for action port [ 840.346616] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_rules [ 840.347075] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e with Priority: HIGHEST for action security_group_members [ 840.347075] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 with Priority: HIGHEST for action security_group_members [ 840.347179] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0475f73c-bd08-4252-a0b4-0d5eada8263e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.347247] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.347423] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-164ae16c-e4a1-4c69-9fb1-592f45a8fea3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.347519] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.347579] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.348228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.348228] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('164ae16c-e4a1-4c69-9fb1-592f45a8fea3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.522489] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.522670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.522934] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-12ef32f4-0ec6-49d3-b916-b716b6764c0b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.523089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.523187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.523593] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.523810] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12ef32f4-0ec6-49d3-b916-b716b6764c0b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.524930] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.524930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.525163] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0475f73c-bd08-4252-a0b4-0d5eada8263e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.525252] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.525448] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.525554] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.526592] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.526738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.542189] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.542362] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.542400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.542684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.542684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.542776] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 840.569556] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.570037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.570114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.570338] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.570485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.578307] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 840.604635] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 840.604862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.605044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.605303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.605503] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.605644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.605737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.605907] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.605992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.606096] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.606190] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.607663] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e in Status: SUCCESS [ 840.607872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.608061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.608273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.608449] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.608567] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.608631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.608772] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.608849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.608942] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.609699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.609861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.610088] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.610245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.610313] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.610460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.610553] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.610637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.610729] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0475f73c-bd08-4252-a0b4-0d5eada8263e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.611913] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.612096] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.612249] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.612346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.612411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.612538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.612692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.612692] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0475f73c-bd08-4252-a0b4-0d5eada8263e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.790678] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('164ae16c-e4a1-4c69-9fb1-592f45a8fea3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.032760] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12ef32f4-0ec6-49d3-b916-b716b6764c0b with status ACTIVE [ 841.032982] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.033159] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.033262] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.033561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.033654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.033844] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.033943] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.034011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.034239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.034343] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.034598] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.034698] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.034761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.034905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.034977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.035072] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12ef32f4-0ec6-49d3-b916-b716b6764c0b is going to be updated. [ 841.056115] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.056254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.056321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.056521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.056658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.056811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12ef32f4-0ec6-49d3-b916-b716b6764c0b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.112921] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.112999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.113247] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.114223] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0475f73c-bd08-4252-a0b4-0d5eada8263e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.115498] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0475f73c-bd08-4252-a0b4-0d5eada8263e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.294976] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('164ae16c-e4a1-4c69-9fb1-592f45a8fea3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.617711] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.618517] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0475f73c-bd08-4252-a0b4-0d5eada8263e: rpc.has_security_group_logging(os_id): False [ 841.619988] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0475f73c-bd08-4252-a0b4-0d5eada8263e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.638408] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.638643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.638711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.638890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.638980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.639223] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.639324] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.639389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.639549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.639629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.639739] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e is going to be created. [ 841.697657] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.697794] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.697941] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.698286] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.698388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.712320] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e in Status: IN_PROGRESS for 2s [ 841.799450] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.799799] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.799799] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.799943] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.800044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.800323] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 is going to be created. [ 841.837329] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.837329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.837329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.837329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.837329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.848437] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 in Status: UNINITIALIZED for 2s [ 841.950925] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db in Status: SUCCESS [ 841.951725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.954730] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: SUCCESS [ 841.955024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.955973] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 841.956212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.997366] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 in Status: SUCCESS [ 841.997695] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.998762] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b419c77-3987-4359-99fb-b76e7165ba63 in Status: SUCCESS [ 841.998991] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.068928] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: SUCCESS [ 842.068928] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.120586] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.120826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.120924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.122068] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.122068] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.122068] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 842.126050] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.126050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.126050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.126050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.126050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.126050] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e is going to be updated. [ 842.150888] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.151031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.151104] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.151346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.151502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.153723] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.153834] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.153899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.154099] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.154223] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.167545] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 842.168329] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e in Status: IN_PROGRESS for 2s [ 842.591314] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 842.592014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.592014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.592149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.592419] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.592419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.592533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.592615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.592695] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.592813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.592911] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.095448] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.095448] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.095769] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.095866] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.097011] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.097011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.097011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.097011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.097011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.097011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.097011] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.097011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.097297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.098221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.098410] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.098566] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.099026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.099026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.099026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.099026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.099026] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.219435] env[69637]: INFO networking_nsxv3.common.synchronization [req-dccb15a5-31ab-4f8a-85c1-35d090c765f2 req-3e0b48ec-ee36-4eda-916e-46f69f0ad713 tempest-ImagesNegativeTestJSON-294850555 tempest-ImagesNegativeTestJSON-294850555-project-member] Enqueued Resource ID: 15e5246e-0aad-4687-8222-4618f13b02fa with Priority: HIGHEST for action security_group_members [ 843.219974] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e5246e-0aad-4687-8222-4618f13b02fa with Priority: HIGHEST for action security_group_members [ 843.220642] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-15e5246e-0aad-4687-8222-4618f13b02fa taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.220642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.220642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.220823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.220864] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.220939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.220998] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.221940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.222031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.222135] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15e5246e-0aad-4687-8222-4618f13b02fa',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.281952] env[69637]: INFO networking_nsxv3.common.synchronization [req-5e8bfdb0-da87-4bd9-a71f-f0d0e43f0146 req-cb8eef80-e5da-4f80-bc1d-652908d1dfcb tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e with Priority: HIGHEST for action security_group_members [ 843.282155] env[69637]: INFO networking_nsxv3.common.synchronization [req-5e8bfdb0-da87-4bd9-a71f-f0d0e43f0146 req-cb8eef80-e5da-4f80-bc1d-652908d1dfcb tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 843.282289] env[69637]: INFO networking_nsxv3.common.synchronization [req-5e8bfdb0-da87-4bd9-a71f-f0d0e43f0146 req-cb8eef80-e5da-4f80-bc1d-652908d1dfcb tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 with Priority: HIGHEST for action security_group_members [ 843.282814] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e with Priority: HIGHEST for action security_group_members [ 843.282952] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 843.283227] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 with Priority: HIGHEST for action security_group_members [ 843.283876] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0475f73c-bd08-4252-a0b4-0d5eada8263e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.283982] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.284198] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.284284] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.284457] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.284537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.600915] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bac27816-ae12-436b-86da-6c4bbde7b2ac: rpc.has_security_group_logging(os_id): False [ 843.617872] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.618054] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.618054] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.618277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.636501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.636856] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.637055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.637217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.638051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.638051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.638333] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.638333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.638333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.638678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.638678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.638837] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.639034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.639034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.639201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.639306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.639481] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 843.696250] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.696402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.696494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.696658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.696795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.711564] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 843.720661] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e in Status: SUCCESS [ 843.720865] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.721055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.721279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.721371] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0475f73c-bd08-4252-a0b4-0d5eada8263e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.725122] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.725271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.725342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.725532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.725642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.725876] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.725985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.726059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.726243] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.726277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.726360] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15e5246e-0aad-4687-8222-4618f13b02fa already deleted. [ 843.726439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.858447] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 in Status: SUCCESS [ 843.859270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.859270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.859270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.859270] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.859421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.859465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.860540] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.860540] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.860540] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('164ae16c-e4a1-4c69-9fb1-592f45a8fea3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.932037] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-481 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.932037] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-481" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.932037] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-481" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.932037] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-481" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.932037] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.932037] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.932037] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.932463] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.932802] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.933183] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.933609] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.933837] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.934076] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.934387] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.934586] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.934808] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.957138] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.957138] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 843.957138] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.957138] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-481" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.957138] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-6c1407d1-bba9-482b-8158-871cfda9a19f taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.957138] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-6c1407d1-bba9-482b-8158-871cfda9a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.957138] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-6c1407d1-bba9-482b-8158-871cfda9a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.957138] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-6c1407d1-bba9-482b-8158-871cfda9a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.957138] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c1407d1-bba9-482b-8158-871cfda9a19f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.181397] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e in Status: SUCCESS [ 844.181397] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.181397] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.181397] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.181397] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.181397] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.181397] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.181397] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.181397] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.181397] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0475f73c-bd08-4252-a0b4-0d5eada8263e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.183263] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 844.183683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.183950] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.184241] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.184526] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.184762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.184905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.185157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.185320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.185528] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.242518] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.242717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.242843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.243124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.243226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.243330] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e is going to be deleted. [ 844.290821] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.290821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.290821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.290821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.290821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.290821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.365085] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.365085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.365085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.365085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.365085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.365085] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.365085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.365085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.365085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.365085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.365085] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 is going to be deleted. [ 844.412482] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.413401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.413628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.413766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.413860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.413951] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.414330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.414506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.414688] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.414810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.414875] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.415217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.415302] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.415398] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('164ae16c-e4a1-4c69-9fb1-592f45a8fea3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.460213] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.460213] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.460403] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.460980] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.460980] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.460980] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 6c1407d1-bba9-482b-8158-871cfda9a19f not found, creating... [ 844.461238] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.461478] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.461612] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.461838] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.461980] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.462285] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.462446] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.462567] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.462813] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.462957] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.463505] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 6c1407d1-bba9-482b-8158-871cfda9a19f is going to be created. [ 844.483142] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.483678] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.483773] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.484346] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.484691] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.488573] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-6c1407d1-bba9-482b-8158-871cfda9a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.687379] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.687534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.687611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.687815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.687906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.688103] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.688200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.688263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.688408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.688484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.688571] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e is going to be deleted. [ 844.689572] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.714525] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.714695] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.714853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.714998] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.715150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.715432] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.715617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.715822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.715961] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.716084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.716160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.716349] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.716411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.716504] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0475f73c-bd08-4252-a0b4-0d5eada8263e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.919960] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.920141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.920217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.920436] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.920528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.920951] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.921053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.921124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.921284] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.921421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.921546] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 already deleted. [ 844.921628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.921737] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('164ae16c-e4a1-4c69-9fb1-592f45a8fea3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.922629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.922801] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.922954] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.923607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.923687] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.923879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.924078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.924195] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('164ae16c-e4a1-4c69-9fb1-592f45a8fea3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.193998] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.219181] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.219341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.219410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.219622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.219708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.219905] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.219999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.220111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.220207] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.220277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.220358] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0475f73c-bd08-4252-a0b4-0d5eada8263e already deleted. [ 845.220431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0475f73c-bd08-4252-a0b4-0d5eada8263e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.427520] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.427642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.427712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.427934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.428034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.428237] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.428333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.428388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.428549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.431083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.431083] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 already deleted. [ 845.431083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.431083] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('164ae16c-e4a1-4c69-9fb1-592f45a8fea3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.628182] env[69637]: INFO networking_nsxv3.common.synchronization [req-dccb15a5-31ab-4f8a-85c1-35d090c765f2 req-66f4e6a5-db2f-4b52-94d2-4579ba8d94fb service nova] Enqueued Resource ID: 15e5246e-0aad-4687-8222-4618f13b02fa with Priority: HIGHEST for action security_group_rules [ 845.628182] env[69637]: INFO networking_nsxv3.common.synchronization [req-dccb15a5-31ab-4f8a-85c1-35d090c765f2 req-66f4e6a5-db2f-4b52-94d2-4579ba8d94fb service nova] Enqueued Resource ID: 15e5246e-0aad-4687-8222-4618f13b02fa with Priority: HIGHEST for action security_group_members [ 845.628182] env[69637]: INFO networking_nsxv3.common.synchronization [req-dccb15a5-31ab-4f8a-85c1-35d090c765f2 req-66f4e6a5-db2f-4b52-94d2-4579ba8d94fb service nova] Enqueued Resource ID: 6c1407d1-bba9-482b-8158-871cfda9a19f with Priority: HIGHEST for action port [ 845.628182] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e5246e-0aad-4687-8222-4618f13b02fa with Priority: HIGHEST for action security_group_rules [ 845.628182] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e5246e-0aad-4687-8222-4618f13b02fa with Priority: HIGHEST for action security_group_members [ 845.628182] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c1407d1-bba9-482b-8158-871cfda9a19f with Priority: HIGHEST for action port [ 845.628679] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15e5246e-0aad-4687-8222-4618f13b02fa taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.629351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.629541] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.629926] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.630130] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15e5246e-0aad-4687-8222-4618f13b02fa',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.631121] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-15e5246e-0aad-4687-8222-4618f13b02fa taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.631367] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.631527] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.631790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.632516] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.633151] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.636167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.636167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.636167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.636167] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15e5246e-0aad-4687-8222-4618f13b02fa',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.636167] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c1407d1-bba9-482b-8158-871cfda9a19f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.636167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c1407d1-bba9-482b-8158-871cfda9a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.636167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c1407d1-bba9-482b-8158-871cfda9a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.636167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c1407d1-bba9-482b-8158-871cfda9a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.636167] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c1407d1-bba9-482b-8158-871cfda9a19f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.695759] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.695951] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.696072] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.696263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.696356] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.696478] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 845.729675] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 845.729675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.729998] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.730225] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.730351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.730730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.730975] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.732575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.733252] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.733252] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.742689] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 845.888669] env[69637]: INFO networking_nsxv3.common.synchronization [None req-a37c5a29-afe2-4659-8766-2cbda3a23b43 None None] Enqueued Resource ID: e46da56d-cb46-4a08-8fff-ba3cd8fd9830 with Priority: HIGHEST for action port [ 845.889541] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e46da56d-cb46-4a08-8fff-ba3cd8fd9830 with Priority: HIGHEST for action port [ 845.890355] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-e46da56d-cb46-4a08-8fff-ba3cd8fd9830 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.890355] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e46da56d-cb46-4a08-8fff-ba3cd8fd9830" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.891033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e46da56d-cb46-4a08-8fff-ba3cd8fd9830" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.891033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e46da56d-cb46-4a08-8fff-ba3cd8fd9830" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.891139] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e46da56d-cb46-4a08-8fff-ba3cd8fd9830',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.937588] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 164ae16c-e4a1-4c69-9fb1-592f45a8fea3: rpc.has_security_group_logging(os_id): False [ 845.955245] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.955624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.955624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.955738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.955738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.956433] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.956433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.956433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.956433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.956433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.956433] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 is going to be created. [ 845.979068] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/164ae16c-e4a1-4c69-9fb1-592f45a8fea3], does not exist path=[/infra/domains/default/groups/164ae16c-e4a1-4c69-9fb1-592f45a8fea3]."\n}' [ 845.979416] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/164ae16c-e4a1-4c69-9fb1-592f45a8fea3 [ 845.979616] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 846.012037] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.012037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.012037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.012037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.012037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.012037] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.013251] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.013333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.013641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.013641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.013824] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.013824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.014111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.014170] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.014246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.014335] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 164ae16c-e4a1-4c69-9fb1-592f45a8fea3 is going to be created. [ 846.034062] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/164ae16c-e4a1-4c69-9fb1-592f45a8fea3], does not exist path=[/infra/domains/default/groups/164ae16c-e4a1-4c69-9fb1-592f45a8fea3]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/164ae16c-e4a1-4c69-9fb1-592f45a8fea3 [ 846.034062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-164ae16c-e4a1-4c69-9fb1-592f45a8fea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.034645] env[69637]: Traceback (most recent call last): [ 846.034797] env[69637]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 846.034797] env[69637]: return func(*args, **kwargs) [ 846.034797] env[69637]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 846.034797] env[69637]: res.raise_for_status() [ 846.034797] env[69637]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 846.034797] env[69637]: raise HTTPError(http_error_msg, response=self) [ 846.034797] env[69637]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/164ae16c-e4a1-4c69-9fb1-592f45a8fea3 [ 846.034797] env[69637]: During handling of the above exception, another exception occurred: [ 846.034797] env[69637]: Traceback (most recent call last): [ 846.034797] env[69637]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 846.034797] env[69637]: listener.cb(fileno) [ 846.034797] env[69637]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 846.034797] env[69637]: result = function(*args, **kwargs) [ 846.034797] env[69637]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 846.034797] env[69637]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 846.034797] env[69637]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 846.034797] env[69637]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 846.034797] env[69637]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 846.034797] env[69637]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 846.034797] env[69637]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 846.034797] env[69637]: res.raise_for_status() [ 846.034797] env[69637]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 846.034797] env[69637]: raise HTTPError(http_error_msg, response=self) [ 846.034797] env[69637]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/164ae16c-e4a1-4c69-9fb1-592f45a8fea3 [ 846.034797] env[69637]: Removing descriptor: 13 [ 846.137256] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-15e5246e-0aad-4687-8222-4618f13b02fa taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.137422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.137766] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15e5246e-0aad-4687-8222-4618f13b02fa',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.138601] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c1407d1-bba9-482b-8158-871cfda9a19f with status ACTIVE [ 846.138759] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.138870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.138947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.139197] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.139303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.139475] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.139663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.139663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.139793] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.139872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.140190] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.140312] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.140375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.140614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.140614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.141311] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c1407d1-bba9-482b-8158-871cfda9a19f is going to be updated. [ 846.161776] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.161776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.161955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.162067] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.162185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.162333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c1407d1-bba9-482b-8158-871cfda9a19f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.238276] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.238641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.238641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.240594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.240594] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.240594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.240594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.240594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.240594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.240594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.240594] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.393962] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e46da56d-cb46-4a08-8fff-ba3cd8fd9830 [ 846.394754] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.394754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.394754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.394929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.394929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.395096] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e46da56d-cb46-4a08-8fff-ba3cd8fd9830 already deleted. [ 846.395213] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e46da56d-cb46-4a08-8fff-ba3cd8fd9830" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.643061] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15e5246e-0aad-4687-8222-4618f13b02fa',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.746689] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.746875] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.746935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.747115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.747286] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.747406] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.747463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.747606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.747689] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.747774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.747920] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.748018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.748083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.748224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.748356] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.748442] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.748502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.748636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.748716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.748799] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.748882] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.146012] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.146327] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.146327] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.146811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.146811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.146894] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15e5246e-0aad-4687-8222-4618f13b02fa is going to be created. [ 847.173138] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.173138] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.173138] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.173138] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.173138] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.188872] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15e5246e-0aad-4687-8222-4618f13b02fa in Status: UNINITIALIZED for 2s [ 847.252450] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bac27816-ae12-436b-86da-6c4bbde7b2ac: rpc.has_security_group_logging(os_id): False [ 847.271306] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.271306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.271306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.271472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.294079] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.294396] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.294551] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.294636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.294910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.295057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.295384] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.295433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.295495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.295652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.295724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.295921] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.296158] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.296263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.296411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.296484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.296569] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 847.363341] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.363669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.363781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.364027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.364286] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.381098] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 847.755957] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 847.755957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.755957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.755957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.755957] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.755957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.755957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.755957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.755957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.755957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.755957] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.755957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.755957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.755957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.757658] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.757658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.757785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.758729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.758729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.758729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.758729] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.759194] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.759322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.759476] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.759580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.759708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.759868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.759954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.760060] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.263147] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1db16c79-2ca0-4113-99b1-64acc68fd18a: rpc.has_security_group_logging(os_id): False [ 848.264379] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.286248] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.286388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.286454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.286767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.305124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.305429] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.305553] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.305621] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.305853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.305927] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.306131] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.306240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.306305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.306452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.306539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.306723] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.306833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.306888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.307036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.307125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.307213] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 848.313095] env[69637]: INFO networking_nsxv3.common.synchronization [req-734e434d-433b-44cb-8d1f-84bce0378a69 req-a804943f-8e2e-4d3e-9a60-686b75c5021f tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 1236a1fa-0205-4a17-909f-c8686b475a69 with Priority: HIGHEST for action security_group_members [ 848.313637] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1236a1fa-0205-4a17-909f-c8686b475a69 with Priority: HIGHEST for action security_group_members [ 848.315256] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1236a1fa-0205-4a17-909f-c8686b475a69 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.315256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.315256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.315256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.315472] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.315472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.315555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.315864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.315946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.316052] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1236a1fa-0205-4a17-909f-c8686b475a69',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.376472] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.376472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.376472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.376472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.376472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.397872] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 848.528377] env[69637]: INFO networking_nsxv3.common.synchronization [None req-0393fb5a-ac3c-455e-b2a4-93e8c63981e0 None None] Enqueued Resource ID: 976583ae-443c-4a97-946c-cfd83dce606d with Priority: HIGHEST for action port [ 848.529506] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 976583ae-443c-4a97-946c-cfd83dce606d with Priority: HIGHEST for action port [ 848.531562] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-976583ae-443c-4a97-946c-cfd83dce606d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.531792] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-976583ae-443c-4a97-946c-cfd83dce606d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.532162] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-976583ae-443c-4a97-946c-cfd83dce606d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.532736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-976583ae-443c-4a97-946c-cfd83dce606d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.532914] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('976583ae-443c-4a97-946c-cfd83dce606d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.766611] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.821168] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.821326] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.821399] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.821622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.821716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.821906] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.822011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.822085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.822235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.822309] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.822394] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1236a1fa-0205-4a17-909f-c8686b475a69 already deleted. [ 848.822470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.036061] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 976583ae-443c-4a97-946c-cfd83dce606d [ 849.036324] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.036464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.036533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.036750] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.036839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.036936] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:976583ae-443c-4a97-946c-cfd83dce606d already deleted. [ 849.037040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-976583ae-443c-4a97-946c-cfd83dce606d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.164799] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-149 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.165009] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.165141] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.165406] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.165664] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.165821] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.165939] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.167366] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.167539] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.167781] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.167899] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.168015] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.168135] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.168248] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.168357] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.168490] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.188052] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.188493] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 849.188746] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.191341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.191341] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-3da513cf-be49-42d9-a7d8-8706b3df0496 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.191341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-3da513cf-be49-42d9-a7d8-8706b3df0496" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.191341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-3da513cf-be49-42d9-a7d8-8706b3df0496" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.191341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-3da513cf-be49-42d9-a7d8-8706b3df0496" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.191341] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3da513cf-be49-42d9-a7d8-8706b3df0496',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.200430] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15e5246e-0aad-4687-8222-4618f13b02fa in Status: SUCCESS [ 849.200622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.200768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.200967] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.201173] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.201282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.201344] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.201509] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.201652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.201746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.201831] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15e5246e-0aad-4687-8222-4618f13b02fa',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.269251] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.269629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.269629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.269743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.269793] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.269849] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 849.302891] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.302891] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.302891] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.302891] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.302891] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.310508] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 849.399346] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 849.399584] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.693755] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.693966] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.694122] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.694463] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.694625] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.694788] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 3da513cf-be49-42d9-a7d8-8706b3df0496 not found, creating... [ 849.695077] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.695244] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.695366] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.695590] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.695733] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.696054] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.696219] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.696341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.696552] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.696690] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.696840] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 3da513cf-be49-42d9-a7d8-8706b3df0496 is going to be created. [ 849.704844] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-15e5246e-0aad-4687-8222-4618f13b02fa taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.704987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.705027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.705192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.705344] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.705444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.705542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.705729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.705805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.706056] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.706056] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-15e5246e-0aad-4687-8222-4618f13b02fa taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.706161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.706202] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.706344] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.706483] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.706575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.706637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.706774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.706847] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.706928] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.707028] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15e5246e-0aad-4687-8222-4618f13b02fa',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.714948] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.715166] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.715323] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.715575] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.715836] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.716108] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-3da513cf-be49-42d9-a7d8-8706b3df0496" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.208966] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15e5246e-0aad-4687-8222-4618f13b02fa: rpc.has_security_group_logging(os_id): False [ 850.225768] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.225899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.225941] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.226169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.226259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.226454] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.226589] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.226645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.226758] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.226833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.227048] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.227147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.227210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.227356] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.227422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.227600] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.227691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.227754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.227889] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.227961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.228056] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15e5246e-0aad-4687-8222-4618f13b02fa is going to be created. [ 850.288821] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.289107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.289107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.289284] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.289457] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.304205] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15e5246e-0aad-4687-8222-4618f13b02fa in Status: IN_PROGRESS for 2s [ 850.422851] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 850.423084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.423265] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.423728] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.423845] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.548703] env[69637]: INFO networking_nsxv3.common.synchronization [req-734e434d-433b-44cb-8d1f-84bce0378a69 req-26f3ca60-bafa-4225-a82f-739111d0060c service nova] Enqueued Resource ID: 1236a1fa-0205-4a17-909f-c8686b475a69 with Priority: HIGHEST for action security_group_rules [ 850.548885] env[69637]: INFO networking_nsxv3.common.synchronization [req-734e434d-433b-44cb-8d1f-84bce0378a69 req-26f3ca60-bafa-4225-a82f-739111d0060c service nova] Enqueued Resource ID: 1236a1fa-0205-4a17-909f-c8686b475a69 with Priority: HIGHEST for action security_group_members [ 850.549033] env[69637]: INFO networking_nsxv3.common.synchronization [req-734e434d-433b-44cb-8d1f-84bce0378a69 req-26f3ca60-bafa-4225-a82f-739111d0060c service nova] Enqueued Resource ID: 3da513cf-be49-42d9-a7d8-8706b3df0496 with Priority: HIGHEST for action port [ 850.550076] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1236a1fa-0205-4a17-909f-c8686b475a69 with Priority: HIGHEST for action security_group_rules [ 850.550076] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1236a1fa-0205-4a17-909f-c8686b475a69 with Priority: HIGHEST for action security_group_members [ 850.550076] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3da513cf-be49-42d9-a7d8-8706b3df0496 with Priority: HIGHEST for action port [ 850.554727] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1236a1fa-0205-4a17-909f-c8686b475a69 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.554875] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.554943] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.555169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.555246] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1236a1fa-0205-4a17-909f-c8686b475a69',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.557117] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1236a1fa-0205-4a17-909f-c8686b475a69 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.557238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.557305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.557474] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.557625] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.557714] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.557773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.557907] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.557984] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.562177] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1236a1fa-0205-4a17-909f-c8686b475a69',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.563090] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-3da513cf-be49-42d9-a7d8-8706b3df0496 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.563191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3da513cf-be49-42d9-a7d8-8706b3df0496" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.565732] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3da513cf-be49-42d9-a7d8-8706b3df0496" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.565732] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3da513cf-be49-42d9-a7d8-8706b3df0496" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.565732] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3da513cf-be49-42d9-a7d8-8706b3df0496',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.926258] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.926390] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.065120] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1236a1fa-0205-4a17-909f-c8686b475a69',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.066171] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1236a1fa-0205-4a17-909f-c8686b475a69 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.066279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.066607] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3da513cf-be49-42d9-a7d8-8706b3df0496 with status ACTIVE [ 851.066772] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.066877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.066995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.067149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.067238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.067403] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.067497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.067559] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.067972] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.067972] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.068094] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.068151] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.068189] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.068333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.068405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.068485] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3da513cf-be49-42d9-a7d8-8706b3df0496 is going to be updated. [ 851.088831] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.089011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.089064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.089301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.089537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.089610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3da513cf-be49-42d9-a7d8-8706b3df0496" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.318806] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 851.319076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.319213] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.319463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.319609] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.319723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.319803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.319934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.320031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.320118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.320207] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.567276] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1236a1fa-0205-4a17-909f-c8686b475a69',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.695294] env[69637]: INFO networking_nsxv3.common.synchronization [req-2322154f-bdb2-4284-b8ce-5a5c9fb9f681 req-4f0308d1-49fa-482d-8035-7a3c7332bf14 tempest-AttachInterfacesUnderV243Test-1189967474 tempest-AttachInterfacesUnderV243Test-1189967474-project-member] Enqueued Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_members [ 851.696095] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_members [ 851.696095] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.696095] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.696353] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.696353] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.696603] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.696603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.696603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.696757] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.700021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.700021] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.727135] env[69637]: INFO networking_nsxv3.common.synchronization [req-2322154f-bdb2-4284-b8ce-5a5c9fb9f681 req-4f0308d1-49fa-482d-8035-7a3c7332bf14 tempest-AttachInterfacesUnderV243Test-1189967474 tempest-AttachInterfacesUnderV243Test-1189967474-project-member] Enqueued Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_rules [ 851.727337] env[69637]: INFO networking_nsxv3.common.synchronization [req-2322154f-bdb2-4284-b8ce-5a5c9fb9f681 req-4f0308d1-49fa-482d-8035-7a3c7332bf14 tempest-AttachInterfacesUnderV243Test-1189967474 tempest-AttachInterfacesUnderV243Test-1189967474-project-member] Enqueued Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_members [ 851.727476] env[69637]: INFO networking_nsxv3.common.synchronization [req-2322154f-bdb2-4284-b8ce-5a5c9fb9f681 req-4f0308d1-49fa-482d-8035-7a3c7332bf14 tempest-AttachInterfacesUnderV243Test-1189967474 tempest-AttachInterfacesUnderV243Test-1189967474-project-member] Enqueued Resource ID: 7c825412-dcb7-4362-b92a-1fd671f13480 with Priority: HIGHEST for action port [ 851.728210] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_rules [ 851.728332] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_members [ 851.728430] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c825412-dcb7-4362-b92a-1fd671f13480 with Priority: HIGHEST for action port [ 851.728714] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.728843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.728926] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.730011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.730111] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.731174] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.731277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.731475] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c825412-dcb7-4362-b92a-1fd671f13480 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.731596] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.731767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.731969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.732114] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c825412-dcb7-4362-b92a-1fd671f13480',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.826828] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.826828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.826828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.826828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.826828] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.826828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.826828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.826828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.826828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.826828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.826828] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.826828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.826828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.826828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.826828] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.826828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.827610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.827610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.827610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.827610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.827610] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.074190] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.074190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.074190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.074190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.074190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.074190] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1236a1fa-0205-4a17-909f-c8686b475a69 is going to be created. [ 852.098269] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.098269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.098269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.098269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.098269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.105294] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1236a1fa-0205-4a17-909f-c8686b475a69 in Status: UNINITIALIZED for 2s [ 852.199425] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.234270] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.234417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.237052] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c825412-dcb7-4362-b92a-1fd671f13480 with status ACTIVE [ 852.237052] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.237052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.237262] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.237318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.237369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.237568] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.237669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.237738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.237906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.237985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.238180] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.238275] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.238335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.238475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.238549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.238633] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c825412-dcb7-4362-b92a-1fd671f13480 is going to be updated. [ 852.263096] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.263942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.263942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.263942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.263942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.263942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.319787] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15e5246e-0aad-4687-8222-4618f13b02fa in Status: SUCCESS [ 852.319787] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.330025] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1db16c79-2ca0-4113-99b1-64acc68fd18a: rpc.has_security_group_logging(os_id): False [ 852.361817] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.361817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.361817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.361817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.361817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.361817] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.361817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.361817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.361817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.362120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.362120] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.362183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.362256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.362504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.362504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.362706] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.362800] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.362868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.363042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.363100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.363188] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 852.436529] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.436651] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.436651] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.436847] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.436989] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.452620] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 852.701867] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.206044] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.206044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.206044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.206044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.206044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.206044] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b419c77-3987-4359-99fb-b76e7165ba63 is going to be updated. [ 853.245060] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.245218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.245289] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.245500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.245646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.255025] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b419c77-3987-4359-99fb-b76e7165ba63 in Status: IN_PROGRESS for 2s [ 854.115237] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1236a1fa-0205-4a17-909f-c8686b475a69 in Status: SUCCESS [ 854.115631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.115631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.115842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.116043] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.116158] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.116218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.116375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.116455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.116540] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.116628] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1236a1fa-0205-4a17-909f-c8686b475a69',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.471704] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 854.471961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.472149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.472384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.472470] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.619562] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1236a1fa-0205-4a17-909f-c8686b475a69',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.974643] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.974852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.974931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.975163] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.975341] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.975444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.975504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.975671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.975760] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.975870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.975932] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.123630] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1236a1fa-0205-4a17-909f-c8686b475a69: rpc.has_security_group_logging(os_id): False [ 855.142129] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.142274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.142342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.142546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.142628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.142868] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.142958] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.143033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.143193] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.143264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.143347] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1236a1fa-0205-4a17-909f-c8686b475a69 is going to be created. [ 855.199474] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.199613] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.199679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.199883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.200323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.211639] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1236a1fa-0205-4a17-909f-c8686b475a69 in Status: IN_PROGRESS for 2s [ 855.264623] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b419c77-3987-4359-99fb-b76e7165ba63 in Status: SUCCESS [ 855.264905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.265094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.265325] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.265527] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.265656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.265713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.265860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.265942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.266079] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.429957] env[69637]: INFO networking_nsxv3.common.synchronization [req-89a53bd7-a4e8-4601-b491-37fdfe3a37cd req-bf30497e-0095-44a7-acec-e1c5f00e4772 tempest-AttachInterfacesUnderV243Test-1189967474 tempest-AttachInterfacesUnderV243Test-1189967474-project-member] Enqueued Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_members [ 855.430499] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_members [ 855.431131] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.431268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.449212] env[69637]: INFO networking_nsxv3.common.synchronization [req-89a53bd7-a4e8-4601-b491-37fdfe3a37cd req-bf30497e-0095-44a7-acec-e1c5f00e4772 tempest-AttachInterfacesUnderV243Test-1189967474 tempest-AttachInterfacesUnderV243Test-1189967474-project-member] Enqueued Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_rules [ 855.449395] env[69637]: INFO networking_nsxv3.common.synchronization [req-89a53bd7-a4e8-4601-b491-37fdfe3a37cd req-bf30497e-0095-44a7-acec-e1c5f00e4772 tempest-AttachInterfacesUnderV243Test-1189967474 tempest-AttachInterfacesUnderV243Test-1189967474-project-member] Enqueued Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_members [ 855.449535] env[69637]: INFO networking_nsxv3.common.synchronization [req-89a53bd7-a4e8-4601-b491-37fdfe3a37cd req-bf30497e-0095-44a7-acec-e1c5f00e4772 tempest-AttachInterfacesUnderV243Test-1189967474 tempest-AttachInterfacesUnderV243Test-1189967474-project-member] Enqueued Resource ID: 7c825412-dcb7-4362-b92a-1fd671f13480 with Priority: HIGHEST for action port [ 855.449821] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_rules [ 855.449907] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_members [ 855.449955] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c825412-dcb7-4362-b92a-1fd671f13480 with Priority: HIGHEST for action port [ 855.450491] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.450573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.450760] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.450845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.451034] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c825412-dcb7-4362-b92a-1fd671f13480 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.451138] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.451271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.451385] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.451768] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c825412-dcb7-4362-b92a-1fd671f13480',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.478444] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.478591] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.478665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.478867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.479045] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.479144] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.479195] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.479343] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.479464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.479497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.479776] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.479776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.479861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.479974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.480145] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.480237] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.480298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.480434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.480507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.480590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.483514] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.771084] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.952830] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c825412-dcb7-4362-b92a-1fd671f13480 with status ACTIVE [ 855.953079] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.953204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.953272] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.953475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.953561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.953730] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.953856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.953910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.954105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.954186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.954368] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.954460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.954518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.954655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.954734] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.954818] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c825412-dcb7-4362-b92a-1fd671f13480 is going to be updated. [ 855.974499] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.974641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.974708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.974981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.975142] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.975636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c825412-dcb7-4362-b92a-1fd671f13480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.986093] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1db16c79-2ca0-4113-99b1-64acc68fd18a: rpc.has_security_group_logging(os_id): False [ 856.002941] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.003099] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.003176] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.003422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.004486] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.004486] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.004486] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.004486] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.004486] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.004486] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.004742] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.004843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.004908] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.005082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.005157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.005509] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.005509] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.005509] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.005673] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.005673] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.005787] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 856.098269] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.098402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.098470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.098686] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.098823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.116165] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 856.274418] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.406576] env[69637]: INFO networking_nsxv3.common.synchronization [req-ee192dc5-796b-4eaf-8771-267b010230e9 req-71b0f887-95f4-4ed3-b5f6-13e6a1640785 tempest-ServerDiagnosticsNegativeTest-50246243 tempest-ServerDiagnosticsNegativeTest-50246243-project-member] Enqueued Resource ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 with Priority: HIGHEST for action security_group_members [ 856.406694] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 with Priority: HIGHEST for action security_group_members [ 856.406935] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f700376-4f24-4ccd-a620-7a4e934d5a40 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.409119] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.409213] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.409458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.409618] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.409721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.409782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.409932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.410034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.410136] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f700376-4f24-4ccd-a620-7a4e934d5a40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.777136] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.777136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.777510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.777510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.777510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.777633] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b419c77-3987-4359-99fb-b76e7165ba63 is going to be updated. [ 856.807281] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.807281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.807390] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.807533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.807679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.817517] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b419c77-3987-4359-99fb-b76e7165ba63 in Status: IN_PROGRESS for 2s [ 856.879124] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.879124] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.879124] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.879124] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.879124] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.879802] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.880107] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.882030] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.882030] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.882030] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.882030] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.882030] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.882286] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.882286] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.882343] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.882798] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.903064] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.903064] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 856.903064] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.903064] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.903064] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-bca7b839-91bb-476c-91bd-13f81d1d35c2 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.903064] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-bca7b839-91bb-476c-91bd-13f81d1d35c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.903064] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-bca7b839-91bb-476c-91bd-13f81d1d35c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.903064] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-bca7b839-91bb-476c-91bd-13f81d1d35c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.903539] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bca7b839-91bb-476c-91bd-13f81d1d35c2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.914410] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.914410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.914410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.914410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.914410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.914410] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.914410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.914410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.914410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.914410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.914410] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 already deleted. [ 856.914410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.086680] env[69637]: INFO networking_nsxv3.common.synchronization [None req-14093b4a-6c4c-4226-8707-15b20b70d47f None None] Enqueued Resource ID: 4303eb83-f910-44f1-a7aa-ef42809d9b89 with Priority: HIGHEST for action port [ 857.086680] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4303eb83-f910-44f1-a7aa-ef42809d9b89 with Priority: HIGHEST for action port [ 857.086680] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-4303eb83-f910-44f1-a7aa-ef42809d9b89 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.086680] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4303eb83-f910-44f1-a7aa-ef42809d9b89" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.086680] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4303eb83-f910-44f1-a7aa-ef42809d9b89" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.086680] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4303eb83-f910-44f1-a7aa-ef42809d9b89" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.087703] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4303eb83-f910-44f1-a7aa-ef42809d9b89',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.225225] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1236a1fa-0205-4a17-909f-c8686b475a69 in Status: SUCCESS [ 857.225225] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.407378] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.407378] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.407378] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.407841] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.407841] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.407841] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port bca7b839-91bb-476c-91bd-13f81d1d35c2 not found, creating... [ 857.408573] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.408573] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.408573] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.408766] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.408795] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.409249] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.409459] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.409615] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.409871] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.410193] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.410373] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: bca7b839-91bb-476c-91bd-13f81d1d35c2 is going to be created. [ 857.428822] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.429123] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.429311] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.429604] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.430071] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.430158] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-bca7b839-91bb-476c-91bd-13f81d1d35c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.592126] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4303eb83-f910-44f1-a7aa-ef42809d9b89 [ 857.592355] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.592494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.592563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.592768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.592852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.592946] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4303eb83-f910-44f1-a7aa-ef42809d9b89 already deleted. [ 857.593070] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4303eb83-f910-44f1-a7aa-ef42809d9b89" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.961300] env[69637]: INFO networking_nsxv3.common.synchronization [req-0a9f6e20-cc78-48d5-b0aa-3d2e73030ed3 req-cf6d10f5-b290-4a1b-b8f2-0ad307d063cb tempest-ImagesNegativeTestJSON-294850555 tempest-ImagesNegativeTestJSON-294850555-project-member] Enqueued Resource ID: 15e5246e-0aad-4687-8222-4618f13b02fa with Priority: HIGHEST for action security_group_members [ 857.961883] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e5246e-0aad-4687-8222-4618f13b02fa with Priority: HIGHEST for action security_group_members [ 857.963150] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-15e5246e-0aad-4687-8222-4618f13b02fa taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.963231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.963279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.963500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.963664] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.963728] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.963775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.963933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.964041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.964218] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15e5246e-0aad-4687-8222-4618f13b02fa',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.137023] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 858.137280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.382691] env[69637]: INFO networking_nsxv3.common.synchronization [req-ee192dc5-796b-4eaf-8771-267b010230e9 req-62012d02-26ec-4a4e-924a-4bba33b7a37a service nova] Enqueued Resource ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 with Priority: HIGHEST for action security_group_rules [ 858.382882] env[69637]: INFO networking_nsxv3.common.synchronization [req-ee192dc5-796b-4eaf-8771-267b010230e9 req-62012d02-26ec-4a4e-924a-4bba33b7a37a service nova] Enqueued Resource ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 with Priority: HIGHEST for action security_group_members [ 858.383059] env[69637]: INFO networking_nsxv3.common.synchronization [req-ee192dc5-796b-4eaf-8771-267b010230e9 req-62012d02-26ec-4a4e-924a-4bba33b7a37a service nova] Enqueued Resource ID: bca7b839-91bb-476c-91bd-13f81d1d35c2 with Priority: HIGHEST for action port [ 858.383301] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 with Priority: HIGHEST for action security_group_rules [ 858.383431] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 with Priority: HIGHEST for action security_group_members [ 858.383529] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca7b839-91bb-476c-91bd-13f81d1d35c2 with Priority: HIGHEST for action port [ 858.384337] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f700376-4f24-4ccd-a620-7a4e934d5a40 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.384476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.384546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.384800] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.384903] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f700376-4f24-4ccd-a620-7a4e934d5a40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.385746] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f700376-4f24-4ccd-a620-7a4e934d5a40 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.385860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.385936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.386127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.386269] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.386364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.387922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.387922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.387922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.387922] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f700376-4f24-4ccd-a620-7a4e934d5a40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.387922] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-bca7b839-91bb-476c-91bd-13f81d1d35c2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.387922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bca7b839-91bb-476c-91bd-13f81d1d35c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.387922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bca7b839-91bb-476c-91bd-13f81d1d35c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.387922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bca7b839-91bb-476c-91bd-13f81d1d35c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.387922] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bca7b839-91bb-476c-91bd-13f81d1d35c2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.468918] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.469193] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.469193] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.469261] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.469329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.469524] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.469620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.469677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.470213] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.470269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.470337] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15e5246e-0aad-4687-8222-4618f13b02fa is going to be updated. [ 858.497116] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.497284] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.497334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.497540] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.497681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.505211] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15e5246e-0aad-4687-8222-4618f13b02fa in Status: IN_PROGRESS for 2s [ 858.828092] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b419c77-3987-4359-99fb-b76e7165ba63 in Status: SUCCESS [ 858.828472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.828685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.828966] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.829250] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.829435] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.829550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.829787] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.829929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.830118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.830291] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.831450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.831567] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.831785] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.831951] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.832044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.832197] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.832277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.832365] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.893214] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f700376-4f24-4ccd-a620-7a4e934d5a40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.894290] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f700376-4f24-4ccd-a620-7a4e934d5a40 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.894452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.894549] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bca7b839-91bb-476c-91bd-13f81d1d35c2 with status ACTIVE [ 858.894706] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.894852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.895034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.895260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.895355] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.895540] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.895645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.895767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.895862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.895943] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.896138] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.896259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.896323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.896465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.896539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.896623] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bca7b839-91bb-476c-91bd-13f81d1d35c2 is going to be updated. [ 858.917462] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.917592] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.917662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.917851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.917979] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.918141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bca7b839-91bb-476c-91bd-13f81d1d35c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.926522] env[69637]: INFO networking_nsxv3.common.synchronization [None req-f776c9f5-5186-4c66-b631-15b58a64aed7 None None] Enqueued Resource ID: 8cfe9f56-50d6-4ebe-ab3d-78c6695c8820 with Priority: HIGHEST for action port [ 858.926717] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cfe9f56-50d6-4ebe-ab3d-78c6695c8820 with Priority: HIGHEST for action port [ 858.927246] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cfe9f56-50d6-4ebe-ab3d-78c6695c8820 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.927356] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cfe9f56-50d6-4ebe-ab3d-78c6695c8820" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.927421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cfe9f56-50d6-4ebe-ab3d-78c6695c8820" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.927643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cfe9f56-50d6-4ebe-ab3d-78c6695c8820" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.927719] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cfe9f56-50d6-4ebe-ab3d-78c6695c8820',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.336337] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.336337] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.400119] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f700376-4f24-4ccd-a620-7a4e934d5a40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.404645] env[69637]: INFO networking_nsxv3.common.synchronization [req-b2e6cd32-ba25-422c-9c25-d11acef98788 req-dc0d9c49-715e-4483-b058-16d31000ac41 tempest-AttachInterfacesUnderV243Test-1189967474 tempest-AttachInterfacesUnderV243Test-1189967474-project-member] Enqueued Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_members [ 859.404645] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b419c77-3987-4359-99fb-b76e7165ba63 with Priority: HIGHEST for action security_group_members [ 859.404645] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b419c77-3987-4359-99fb-b76e7165ba63 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.404645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.432852] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cfe9f56-50d6-4ebe-ab3d-78c6695c8820 [ 859.432852] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.432852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.432852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.432852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.432852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.432852] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cfe9f56-50d6-4ebe-ab3d-78c6695c8820 already deleted. [ 859.432852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cfe9f56-50d6-4ebe-ab3d-78c6695c8820" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.543110] env[69637]: INFO networking_nsxv3.common.synchronization [req-5bc893a1-57a1-46f3-ba3c-055769f59fd5 req-60947daf-9976-40e1-a4ce-f9882cdaf865 tempest-ServerGroupTestJSON-61085023 tempest-ServerGroupTestJSON-61085023-project-member] Enqueued Resource ID: ab63da8d-6ab8-41b7-8884-d191739821cb with Priority: HIGHEST for action security_group_members [ 859.543944] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab63da8d-6ab8-41b7-8884-d191739821cb with Priority: HIGHEST for action security_group_members [ 859.544493] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab63da8d-6ab8-41b7-8884-d191739821cb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.544628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.544695] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.544961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.545130] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.545233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.545296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.545448] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.545527] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.545621] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab63da8d-6ab8-41b7-8884-d191739821cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.837448] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b419c77-3987-4359-99fb-b76e7165ba63: rpc.has_security_group_logging(os_id): False [ 859.839779] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.857519] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.857658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.857727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.857940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.877336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.877514] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.877630] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.877695] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.877887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.877961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.878057] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b419c77-3987-4359-99fb-b76e7165ba63 is going to be updated. [ 859.905638] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.905783] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.909548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.909548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.909548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.909688] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 is going to be created. [ 859.929231] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.929407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.929407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.929607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.929752] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.938528] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.938671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.938712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.938932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.939058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.942582] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 in Status: UNINITIALIZED for 2s [ 859.952255] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b419c77-3987-4359-99fb-b76e7165ba63 in Status: IN_PROGRESS for 2s [ 860.050239] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.050239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.050239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.050239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.050239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.050239] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.050239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.050239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.050239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.050239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.050239] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab63da8d-6ab8-41b7-8884-d191739821cb already deleted. [ 860.050239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.207469] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-576 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.211690] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.211690] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.211690] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.211690] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.211690] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.211690] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.211690] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.211690] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.211690] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 860.211690] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 860.211690] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 860.211690] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 860.211690] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 860.211690] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 860.211690] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 860.259159] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 860.259229] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 860.259377] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 860.259559] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.259877] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-bedd1d12-9a95-42c8-be4e-cc7d9070f5d0 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.260067] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-bedd1d12-9a95-42c8-be4e-cc7d9070f5d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.261129] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-bedd1d12-9a95-42c8-be4e-cc7d9070f5d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.261129] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-bedd1d12-9a95-42c8-be4e-cc7d9070f5d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.261129] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bedd1d12-9a95-42c8-be4e-cc7d9070f5d0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.344218] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.344218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.344218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.344218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.344218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.344556] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b419c77-3987-4359-99fb-b76e7165ba63 is going to be updated. [ 860.373989] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.374255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.374255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.374421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.375085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.383743] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b419c77-3987-4359-99fb-b76e7165ba63 in Status: IN_PROGRESS for 2s [ 860.517671] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15e5246e-0aad-4687-8222-4618f13b02fa in Status: SUCCESS [ 860.517852] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15e5246e-0aad-4687-8222-4618f13b02fa deletion is rescheduled due to dependency. [ 860.518010] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.767489] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.767855] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.767855] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.768111] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.768274] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.768435] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port bedd1d12-9a95-42c8-be4e-cc7d9070f5d0 not found, creating... [ 860.768684] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.768840] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.768959] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.769197] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.769336] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.769615] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.769771] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.769891] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.772959] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.772959] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.772959] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: bedd1d12-9a95-42c8-be4e-cc7d9070f5d0 is going to be created. [ 860.795225] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.795380] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.795509] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.795787] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.796035] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.796279] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-bedd1d12-9a95-42c8-be4e-cc7d9070f5d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.604016] env[69637]: INFO networking_nsxv3.common.synchronization [req-5bc893a1-57a1-46f3-ba3c-055769f59fd5 req-e53fc237-24f5-4ab8-bc75-dbae6c0a404c service nova] Enqueued Resource ID: ab63da8d-6ab8-41b7-8884-d191739821cb with Priority: HIGHEST for action security_group_rules [ 861.604016] env[69637]: INFO networking_nsxv3.common.synchronization [req-5bc893a1-57a1-46f3-ba3c-055769f59fd5 req-e53fc237-24f5-4ab8-bc75-dbae6c0a404c service nova] Enqueued Resource ID: ab63da8d-6ab8-41b7-8884-d191739821cb with Priority: HIGHEST for action security_group_members [ 861.604016] env[69637]: INFO networking_nsxv3.common.synchronization [req-5bc893a1-57a1-46f3-ba3c-055769f59fd5 req-e53fc237-24f5-4ab8-bc75-dbae6c0a404c service nova] Enqueued Resource ID: bedd1d12-9a95-42c8-be4e-cc7d9070f5d0 with Priority: HIGHEST for action port [ 861.604016] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab63da8d-6ab8-41b7-8884-d191739821cb with Priority: HIGHEST for action security_group_rules [ 861.604016] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab63da8d-6ab8-41b7-8884-d191739821cb with Priority: HIGHEST for action security_group_members [ 861.604016] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bedd1d12-9a95-42c8-be4e-cc7d9070f5d0 with Priority: HIGHEST for action port [ 861.604016] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab63da8d-6ab8-41b7-8884-d191739821cb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.605814] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.605814] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.606163] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.606430] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab63da8d-6ab8-41b7-8884-d191739821cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.608186] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab63da8d-6ab8-41b7-8884-d191739821cb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.608186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.608186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.608186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.608616] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.608823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.609028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.609394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.609565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.609737] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab63da8d-6ab8-41b7-8884-d191739821cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.611070] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-bedd1d12-9a95-42c8-be4e-cc7d9070f5d0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.611070] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bedd1d12-9a95-42c8-be4e-cc7d9070f5d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.611070] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bedd1d12-9a95-42c8-be4e-cc7d9070f5d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.611427] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bedd1d12-9a95-42c8-be4e-cc7d9070f5d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.611592] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bedd1d12-9a95-42c8-be4e-cc7d9070f5d0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.952721] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 in Status: SUCCESS [ 861.953055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.954589] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.954589] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.954589] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.954589] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.954817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.954817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.954873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.955597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.955597] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f700376-4f24-4ccd-a620-7a4e934d5a40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.966744] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b419c77-3987-4359-99fb-b76e7165ba63 in Status: SUCCESS [ 861.966995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.967634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.967742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.967742] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.114382] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab63da8d-6ab8-41b7-8884-d191739821cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.116210] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab63da8d-6ab8-41b7-8884-d191739821cb taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.116329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.116698] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bedd1d12-9a95-42c8-be4e-cc7d9070f5d0 with status ACTIVE [ 862.116698] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.116814] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.116856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.117137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.117241] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.117454] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.117594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.117662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.117850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.117888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.118154] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.118831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.118904] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.119081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.119202] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.119278] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bedd1d12-9a95-42c8-be4e-cc7d9070f5d0 is going to be updated. [ 862.139347] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.139530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.139613] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.139789] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.139923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.140095] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bedd1d12-9a95-42c8-be4e-cc7d9070f5d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.395123] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b419c77-3987-4359-99fb-b76e7165ba63 in Status: SUCCESS [ 862.395123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.395805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.395905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.396079] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.396203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.396278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.396448] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.396539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.396639] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.457177] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f700376-4f24-4ccd-a620-7a4e934d5a40 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.457331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.457405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.457624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.457791] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.457887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.457951] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.459395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.459395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.459395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.459395] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f700376-4f24-4ccd-a620-7a4e934d5a40 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.459395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.459395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.459395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.459395] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.459395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.459395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.459395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.459395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.459395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.459395] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f700376-4f24-4ccd-a620-7a4e934d5a40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.486364] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.486560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.486560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.486751] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.486838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.486936] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b419c77-3987-4359-99fb-b76e7165ba63 is going to be deleted. [ 862.541096] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.541354] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.541467] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.541727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.541878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.542079] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.621220] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab63da8d-6ab8-41b7-8884-d191739821cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.899893] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.899893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.899893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.899893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.899893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.899893] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.900178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.900178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.900178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.900270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.900303] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b419c77-3987-4359-99fb-b76e7165ba63 is going to be deleted. [ 862.934741] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.936860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.936955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.937224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.937396] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.937607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.939363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.939363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.939363] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.939363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.939363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.939363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.939363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.939363] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b419c77-3987-4359-99fb-b76e7165ba63',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.962754] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f700376-4f24-4ccd-a620-7a4e934d5a40: rpc.has_security_group_logging(os_id): False [ 862.982362] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.982504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.982574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.982784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.982869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.983093] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.983199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.983248] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.983393] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.983469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.983642] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.983735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.983819] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.983945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.984102] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.984258] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.984346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.984346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.984475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.984542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.984974] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 is going to be created. [ 863.008540] env[69637]: INFO networking_nsxv3.common.synchronization [req-2b58f852-3fbb-409d-8ee6-74adfb61c47d req-6862300e-88db-4c85-8ff4-ca828dd86fd6 tempest-ServersAdminTestJSON-567435686 tempest-ServersAdminTestJSON-567435686-project-member] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 863.009088] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 863.009398] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.009518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.009605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.009781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.009930] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.010692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.010781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.010962] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.011075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.011180] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.060842] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.061066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.061146] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.061364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.061548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.073630] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 in Status: IN_PROGRESS for 2s [ 863.124422] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.124788] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.125502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.127899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.127899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.127899] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab63da8d-6ab8-41b7-8884-d191739821cb is going to be created. [ 863.165870] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.165870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.165870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.166034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.166120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.179329] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab63da8d-6ab8-41b7-8884-d191739821cb in Status: UNINITIALIZED for 2s [ 863.319017] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-255 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.319017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.319017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.319017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.319017] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.319017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.319447] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.319768] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.320028] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.320333] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 863.320619] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 863.320852] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 863.321072] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 863.321287] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 863.321491] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 863.322808] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 863.340677] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 863.340861] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 863.340990] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 863.341179] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-255" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.341485] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-8a2536eb-7c3a-49bf-897e-ce0e7247ca5a taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.341655] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-8a2536eb-7c3a-49bf-897e-ce0e7247ca5a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.341774] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-8a2536eb-7c3a-49bf-897e-ce0e7247ca5a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.342102] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-8a2536eb-7c3a-49bf-897e-ce0e7247ca5a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.342246] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a2536eb-7c3a-49bf-897e-ce0e7247ca5a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.442056] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.442172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.442208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.442562] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.442685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.442941] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.443097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.443179] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.443572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.443572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.443572] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b419c77-3987-4359-99fb-b76e7165ba63 already deleted. [ 863.443572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b419c77-3987-4359-99fb-b76e7165ba63" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.518914] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.844767] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.845017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.845251] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.845446] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.845593] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.845751] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 8a2536eb-7c3a-49bf-897e-ce0e7247ca5a not found, creating... [ 863.846015] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.846180] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.846388] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.846507] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.846643] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.846925] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.847113] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.847251] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.847462] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.847598] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.847738] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 8a2536eb-7c3a-49bf-897e-ce0e7247ca5a is going to be created. [ 863.869257] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.869510] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.869643] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.869909] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.870162] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.870399] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-8a2536eb-7c3a-49bf-897e-ce0e7247ca5a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.019646] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.522333] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.522333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.522333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.522723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.522723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.522723] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 is going to be updated. [ 864.556583] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.556746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.556795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.557281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.557281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.566446] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: IN_PROGRESS for 2s [ 864.597346] env[69637]: INFO networking_nsxv3.common.synchronization [req-2b58f852-3fbb-409d-8ee6-74adfb61c47d req-bc0c51e3-c668-4bb9-8087-7b5180d8a069 service nova] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_rules [ 864.597533] env[69637]: INFO networking_nsxv3.common.synchronization [req-2b58f852-3fbb-409d-8ee6-74adfb61c47d req-bc0c51e3-c668-4bb9-8087-7b5180d8a069 service nova] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 864.597674] env[69637]: INFO networking_nsxv3.common.synchronization [req-2b58f852-3fbb-409d-8ee6-74adfb61c47d req-bc0c51e3-c668-4bb9-8087-7b5180d8a069 service nova] Enqueued Resource ID: 8a2536eb-7c3a-49bf-897e-ce0e7247ca5a with Priority: HIGHEST for action port [ 864.598670] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_rules [ 864.598670] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 864.598670] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a2536eb-7c3a-49bf-897e-ce0e7247ca5a with Priority: HIGHEST for action port [ 864.598876] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.598876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.598876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.600516] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.600643] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.602654] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.602654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.605092] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a2536eb-7c3a-49bf-897e-ce0e7247ca5a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.605092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a2536eb-7c3a-49bf-897e-ce0e7247ca5a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.605092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a2536eb-7c3a-49bf-897e-ce0e7247ca5a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.605092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a2536eb-7c3a-49bf-897e-ce0e7247ca5a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.605092] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a2536eb-7c3a-49bf-897e-ce0e7247ca5a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.088920] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 in Status: SUCCESS [ 865.091214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.106865] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.106865] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.108035] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a2536eb-7c3a-49bf-897e-ce0e7247ca5a with status ACTIVE [ 865.108246] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.108378] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.108421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.108605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.108694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.108903] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.108963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.108997] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.109164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.109240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.109418] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.109510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.109570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.109707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.109781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.109866] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a2536eb-7c3a-49bf-897e-ce0e7247ca5a is going to be updated. [ 865.135772] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.135919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.135989] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.136214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.136360] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.136521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a2536eb-7c3a-49bf-897e-ce0e7247ca5a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.189154] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab63da8d-6ab8-41b7-8884-d191739821cb in Status: SUCCESS [ 865.189371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.189539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.189751] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.189960] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.190075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.190143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.190299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.190406] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.190532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.190598] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab63da8d-6ab8-41b7-8884-d191739821cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.695749] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab63da8d-6ab8-41b7-8884-d191739821cb taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.695749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.695749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.695749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.695749] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.695749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.695749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.695749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.695749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.695749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.695749] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab63da8d-6ab8-41b7-8884-d191739821cb taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.695749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.695749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.695749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.695749] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.695749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.696505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.696505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.696505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.696505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.696505] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab63da8d-6ab8-41b7-8884-d191739821cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.201659] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab63da8d-6ab8-41b7-8884-d191739821cb: rpc.has_security_group_logging(os_id): False [ 866.218258] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.218437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.218469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.218666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.218753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.218928] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.219035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.219123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.219281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.219358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.219540] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.219631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.219691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.219826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.220093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.220169] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.220224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.220258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.220388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.220461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.220544] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab63da8d-6ab8-41b7-8884-d191739821cb is going to be created. [ 866.282983] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.283327] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.283408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.283627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.284162] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.294353] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab63da8d-6ab8-41b7-8884-d191739821cb in Status: IN_PROGRESS for 2s [ 866.579628] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: SUCCESS [ 866.579628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.579628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.579628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.579628] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.579628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.579628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.579628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.579628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.579628] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.084043] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.585704] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.089884] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.089884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.089884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.089884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.089884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.089884] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 is going to be updated. [ 868.116164] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.116164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.116164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.116164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.118199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.129239] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: IN_PROGRESS for 2s [ 868.305382] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab63da8d-6ab8-41b7-8884-d191739821cb in Status: SUCCESS [ 868.305678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.355979] env[69637]: INFO networking_nsxv3.common.synchronization [req-b64b609c-1b25-438b-ac47-b9bf9429e8c6 req-cd2b6d7e-b579-42b1-8ee9-2006a3bd6ac2 tempest-ServerDiagnosticsNegativeTest-50246243 tempest-ServerDiagnosticsNegativeTest-50246243-project-member] Enqueued Resource ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 with Priority: HIGHEST for action security_group_members [ 869.356618] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 with Priority: HIGHEST for action security_group_members [ 869.356913] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f700376-4f24-4ccd-a620-7a4e934d5a40 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.359591] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.359708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.359929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.360127] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.360240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.360304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.360454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.360540] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.360640] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f700376-4f24-4ccd-a620-7a4e934d5a40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.865065] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.865065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.865065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.865065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.865065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.865065] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.865065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.865065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.865065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.865065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.865065] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 is going to be updated. [ 869.892963] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.892963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.892963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.892963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.892963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.898862] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 in Status: IN_PROGRESS for 2s [ 870.140594] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: SUCCESS [ 870.140959] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.141161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.141369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.141570] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.141688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.141766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.141961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.142070] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.142192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.142397] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.644632] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.645074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.645074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.645074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.645226] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.645326] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.645375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.645516] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.645600] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.645688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.645838] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.645929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.645985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.646143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.646273] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.646365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.646433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.646574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.646672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.646759] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.646845] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.151317] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff9b407c-6313-458e-a95d-b00d9b8914d1: rpc.has_security_group_logging(os_id): False [ 871.168558] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.168741] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.168803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.169521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.185956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.186249] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.186366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.186439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.187234] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.187340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.187553] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.187650] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.187706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.187865] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.187939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.188140] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.188254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.188313] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.188447] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.188515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.188595] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 is going to be updated. [ 871.244478] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.244630] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.244727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.244947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.245480] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.260986] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: IN_PROGRESS for 2s [ 871.909899] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 in Status: SUCCESS [ 871.910182] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f700376-4f24-4ccd-a620-7a4e934d5a40 deletion is rescheduled due to dependency. [ 871.910235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f700376-4f24-4ccd-a620-7a4e934d5a40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.314840] env[69637]: INFO networking_nsxv3.common.synchronization [req-e7785d62-7e9a-4623-9523-1cda16de3579 req-1b5953c2-cfe8-4d90-948e-1595b3530740 tempest-InstanceActionsV221TestJSON-606614272 tempest-InstanceActionsV221TestJSON-606614272-project-member] Enqueued Resource ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d with Priority: HIGHEST for action security_group_members [ 872.315635] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d with Priority: HIGHEST for action security_group_members [ 872.315897] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.316640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.316716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.316967] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.317150] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.317706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.317791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.317942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.318054] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.318156] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ff0c3ba-5135-40b4-ae76-b08804b8ec7d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.820610] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.820847] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.820966] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.821336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.821446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.821759] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.821923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.822039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.822309] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.822438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.822576] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d already deleted. [ 872.822706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.276367] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: SUCCESS [ 873.276888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.291106] env[69637]: INFO networking_nsxv3.common.synchronization [None req-c7c603a9-e52c-478d-9989-2c9234c355b6 None None] Enqueued Resource ID: 12e91a9b-032b-4674-9bcd-f25a96fd2a65 with Priority: HIGHEST for action port [ 873.291787] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12e91a9b-032b-4674-9bcd-f25a96fd2a65 with Priority: HIGHEST for action port [ 873.292920] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-12e91a9b-032b-4674-9bcd-f25a96fd2a65 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.293641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12e91a9b-032b-4674-9bcd-f25a96fd2a65" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.293746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12e91a9b-032b-4674-9bcd-f25a96fd2a65" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.294047] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12e91a9b-032b-4674-9bcd-f25a96fd2a65" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.294133] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12e91a9b-032b-4674-9bcd-f25a96fd2a65',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.351502] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.351704] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-567" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.351829] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-567" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.352178] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-567" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.352452] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.352613] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.352731] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.352953] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.353111] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.353357] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 873.353481] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.353595] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.353706] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.353819] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 873.353927] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.354074] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.377405] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.377405] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 873.377405] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.377405] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-567" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.377832] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-d76f127c-7bb0-4556-9dcf-f33a28daf751 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.377832] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-d76f127c-7bb0-4556-9dcf-f33a28daf751" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.378089] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-d76f127c-7bb0-4556-9dcf-f33a28daf751" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.378313] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-d76f127c-7bb0-4556-9dcf-f33a28daf751" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.378474] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d76f127c-7bb0-4556-9dcf-f33a28daf751',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.799098] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12e91a9b-032b-4674-9bcd-f25a96fd2a65 [ 873.800175] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.800175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.800175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.800175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.800175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.800175] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12e91a9b-032b-4674-9bcd-f25a96fd2a65 already deleted. [ 873.800175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12e91a9b-032b-4674-9bcd-f25a96fd2a65" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.882284] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.882284] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.882284] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.882647] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.882647] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.883550] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port d76f127c-7bb0-4556-9dcf-f33a28daf751 not found, creating... [ 873.883550] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.883550] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.883550] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.887020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.887020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.887020] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.887020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.887020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.887020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.887020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.887020] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: d76f127c-7bb0-4556-9dcf-f33a28daf751 is going to be created. [ 873.910732] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.910948] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.911084] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.911380] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.911611] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.911832] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-d76f127c-7bb0-4556-9dcf-f33a28daf751" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.976619] env[69637]: INFO networking_nsxv3.common.synchronization [req-12080dff-1cb8-4da5-8c51-7d1255080483 req-b4514af4-a6ff-4051-bb14-c83cfec78a1f tempest-ServerGroupTestJSON-61085023 tempest-ServerGroupTestJSON-61085023-project-member] Enqueued Resource ID: ab63da8d-6ab8-41b7-8884-d191739821cb with Priority: HIGHEST for action security_group_members [ 873.977425] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab63da8d-6ab8-41b7-8884-d191739821cb with Priority: HIGHEST for action security_group_members [ 873.981361] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab63da8d-6ab8-41b7-8884-d191739821cb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.981361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.981361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.981361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.981361] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.981361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.981361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.981361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.981361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.981361] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab63da8d-6ab8-41b7-8884-d191739821cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.481368] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.481643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.481643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.481820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.481912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.482115] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.482211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.482299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.482476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.482508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.482577] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab63da8d-6ab8-41b7-8884-d191739821cb is going to be updated. [ 874.509465] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.509465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.509465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.509465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.509465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.516301] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab63da8d-6ab8-41b7-8884-d191739821cb in Status: IN_PROGRESS for 2s [ 874.635728] env[69637]: INFO networking_nsxv3.common.synchronization [req-e7785d62-7e9a-4623-9523-1cda16de3579 req-a383233b-8497-46ec-b201-de6b421ea08a service nova] Enqueued Resource ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d with Priority: HIGHEST for action security_group_rules [ 874.635918] env[69637]: INFO networking_nsxv3.common.synchronization [req-e7785d62-7e9a-4623-9523-1cda16de3579 req-a383233b-8497-46ec-b201-de6b421ea08a service nova] Enqueued Resource ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d with Priority: HIGHEST for action security_group_members [ 874.636075] env[69637]: INFO networking_nsxv3.common.synchronization [req-e7785d62-7e9a-4623-9523-1cda16de3579 req-a383233b-8497-46ec-b201-de6b421ea08a service nova] Enqueued Resource ID: d76f127c-7bb0-4556-9dcf-f33a28daf751 with Priority: HIGHEST for action port [ 874.636644] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d with Priority: HIGHEST for action security_group_rules [ 874.636779] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d with Priority: HIGHEST for action security_group_members [ 874.636878] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76f127c-7bb0-4556-9dcf-f33a28daf751 with Priority: HIGHEST for action port [ 874.638233] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.638388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.638501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.638766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.638854] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ff0c3ba-5135-40b4-ae76-b08804b8ec7d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.640105] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.640230] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.640309] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.640513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.640683] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.640785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.640849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.641011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.641110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.641199] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ff0c3ba-5135-40b4-ae76-b08804b8ec7d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.641967] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-d76f127c-7bb0-4556-9dcf-f33a28daf751 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.642222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d76f127c-7bb0-4556-9dcf-f33a28daf751" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.642309] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d76f127c-7bb0-4556-9dcf-f33a28daf751" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.642468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d76f127c-7bb0-4556-9dcf-f33a28daf751" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.642554] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d76f127c-7bb0-4556-9dcf-f33a28daf751',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.146405] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.146405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.146599] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ff0c3ba-5135-40b4-ae76-b08804b8ec7d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.147844] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d76f127c-7bb0-4556-9dcf-f33a28daf751 with status ACTIVE [ 875.147844] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.147844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.147844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.148131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.148131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.148333] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.148417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.148500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.148591] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.148669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.148843] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.148929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.148983] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.152964] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.152964] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.152964] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d76f127c-7bb0-4556-9dcf-f33a28daf751 is going to be updated. [ 875.171955] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.172176] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.172265] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.172542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.172656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.172822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d76f127c-7bb0-4556-9dcf-f33a28daf751" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.440084] env[69637]: INFO networking_nsxv3.common.synchronization [None req-ddfa86b9-0147-46bd-a155-c69f51f2d511 None None] Enqueued Resource ID: b1b141a7-8b27-4e65-8204-007d06844440 with Priority: HIGHEST for action port [ 875.440353] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1b141a7-8b27-4e65-8204-007d06844440 with Priority: HIGHEST for action port [ 875.440880] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1b141a7-8b27-4e65-8204-007d06844440 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.441016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1b141a7-8b27-4e65-8204-007d06844440" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.441120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1b141a7-8b27-4e65-8204-007d06844440" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.441323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1b141a7-8b27-4e65-8204-007d06844440" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.441404] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1b141a7-8b27-4e65-8204-007d06844440',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.655446] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ff0c3ba-5135-40b4-ae76-b08804b8ec7d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.943418] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1b141a7-8b27-4e65-8204-007d06844440 [ 875.943418] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.943418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.943418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.943697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.943697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.943786] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1b141a7-8b27-4e65-8204-007d06844440 already deleted. [ 875.943867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1b141a7-8b27-4e65-8204-007d06844440" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.159639] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.160263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.160263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.160263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.160263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.160263] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d is going to be created. [ 876.184013] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.184178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.184246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.184486] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.184644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.193559] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d in Status: UNINITIALIZED for 2s [ 876.534046] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab63da8d-6ab8-41b7-8884-d191739821cb in Status: SUCCESS [ 876.534046] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab63da8d-6ab8-41b7-8884-d191739821cb deletion is rescheduled due to dependency. [ 876.534046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.998107] env[69637]: INFO networking_nsxv3.common.synchronization [req-d8caf4b5-276d-48e9-8c80-8f49bc01c575 req-631121e5-81b5-4e88-86c5-718107c8f0d7 tempest-ServersTestJSON-1659168521 tempest-ServersTestJSON-1659168521-project-member] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 877.998774] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 877.999098] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.999225] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.999293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.999498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.999647] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.999748] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.999809] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.999957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.000117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.000222] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.204832] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d in Status: SUCCESS [ 878.205162] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.206537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.206872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.207153] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.207537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.207651] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.208710] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.208904] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.209075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.209510] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ff0c3ba-5135-40b4-ae76-b08804b8ec7d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.503304] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.537575] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-286 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.538493] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.538640] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.538989] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.539444] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.539686] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.539846] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.540384] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.540661] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.540936] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.541099] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.541252] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.541458] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.541620] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.541791] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.542558] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.561771] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.562719] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 878.563419] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.563419] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.563610] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-5da3fa19-719d-4587-8f80-9ad841597cb2 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.563811] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-5da3fa19-719d-4587-8f80-9ad841597cb2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.563986] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-5da3fa19-719d-4587-8f80-9ad841597cb2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.564393] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-5da3fa19-719d-4587-8f80-9ad841597cb2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.564729] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5da3fa19-719d-4587-8f80-9ad841597cb2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.713585] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.713737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.713805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.714030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.714186] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.714285] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.714375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.714535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.714618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.714702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.714847] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.714933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.714990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.715133] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.715262] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.715371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.715432] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.715572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.715632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.715708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.715792] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ff0c3ba-5135-40b4-ae76-b08804b8ec7d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.861528] env[69637]: INFO networking_nsxv3.common.synchronization [None req-8f4abb80-0882-48e9-a7e6-4f209c525f61 None None] Enqueued Resource ID: 889bf57a-9b79-425b-82dd-8407a8a641b8 with Priority: HIGHEST for action port [ 878.861528] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 889bf57a-9b79-425b-82dd-8407a8a641b8 with Priority: HIGHEST for action port [ 878.862512] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-889bf57a-9b79-425b-82dd-8407a8a641b8 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.862765] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-889bf57a-9b79-425b-82dd-8407a8a641b8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.862925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-889bf57a-9b79-425b-82dd-8407a8a641b8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.864259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-889bf57a-9b79-425b-82dd-8407a8a641b8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.864259] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('889bf57a-9b79-425b-82dd-8407a8a641b8',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.007242] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.067902] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.068136] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.068268] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.068551] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.068720] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.068879] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 5da3fa19-719d-4587-8f80-9ad841597cb2 not found, creating... [ 879.069151] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.069305] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.069782] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.069782] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.069905] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.070092] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.070252] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.070372] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.070635] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.070792] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.070936] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 5da3fa19-719d-4587-8f80-9ad841597cb2 is going to be created. [ 879.096779] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.097532] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.097532] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.097898] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.097898] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.098046] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-5da3fa19-719d-4587-8f80-9ad841597cb2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.218840] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d: rpc.has_security_group_logging(os_id): False [ 879.253112] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.253112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.253112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.253112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.253112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.253112] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.253112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.253112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.254579] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.255114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.256043] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.256043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.256549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.259129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.259129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.259129] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.259129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.259129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.259129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.259129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.259129] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d is going to be created. [ 879.324755] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.327020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.327020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.327020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.327020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.340623] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d in Status: IN_PROGRESS for 2s [ 879.366018] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 889bf57a-9b79-425b-82dd-8407a8a641b8 [ 879.366018] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.366018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.366018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.366417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.366417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.366417] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:889bf57a-9b79-425b-82dd-8407a8a641b8 already deleted. [ 879.366417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-889bf57a-9b79-425b-82dd-8407a8a641b8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.509922] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.509922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.509922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.510154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.510433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.510433] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 879.538641] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.541635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.541635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.541635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.541635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.550011] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 879.883189] env[69637]: INFO networking_nsxv3.common.synchronization [req-d8caf4b5-276d-48e9-8c80-8f49bc01c575 req-e9063672-f2c0-47fe-aeea-20e423cadc53 service nova] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_rules [ 879.883189] env[69637]: INFO networking_nsxv3.common.synchronization [req-d8caf4b5-276d-48e9-8c80-8f49bc01c575 req-e9063672-f2c0-47fe-aeea-20e423cadc53 service nova] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 879.883189] env[69637]: INFO networking_nsxv3.common.synchronization [req-d8caf4b5-276d-48e9-8c80-8f49bc01c575 req-e9063672-f2c0-47fe-aeea-20e423cadc53 service nova] Enqueued Resource ID: 5da3fa19-719d-4587-8f80-9ad841597cb2 with Priority: HIGHEST for action port [ 879.883189] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_rules [ 879.883189] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 879.883189] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da3fa19-719d-4587-8f80-9ad841597cb2 with Priority: HIGHEST for action port [ 879.883189] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.883920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.884111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.884468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.884663] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.885741] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.886077] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.886412] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5da3fa19-719d-4587-8f80-9ad841597cb2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.886691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5da3fa19-719d-4587-8f80-9ad841597cb2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.886848] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5da3fa19-719d-4587-8f80-9ad841597cb2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.887130] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5da3fa19-719d-4587-8f80-9ad841597cb2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.887314] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5da3fa19-719d-4587-8f80-9ad841597cb2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.390041] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.393058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.393058] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5da3fa19-719d-4587-8f80-9ad841597cb2 with status ACTIVE [ 880.393058] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.393058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.393058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.393058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.393058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.393058] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.393058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.393058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.393058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.393058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.393058] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.393058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.393058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.393058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.393058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.393936] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5da3fa19-719d-4587-8f80-9ad841597cb2 is going to be updated. [ 880.415017] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.415181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.415256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.415462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.415603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.415759] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5da3fa19-719d-4587-8f80-9ad841597cb2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.500925] env[69637]: INFO networking_nsxv3.common.synchronization [req-83489897-7ddf-406b-97e4-9fbf4e97009c req-ad9cee6e-99be-42e8-aeb3-012aec8c7cf4 tempest-MultipleCreateTestJSON-1546211828 tempest-MultipleCreateTestJSON-1546211828-project-member] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 880.501122] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 880.501761] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.501873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.501948] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.502259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.502430] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.502544] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.502609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.502762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.502845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.502939] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.996131] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.996400] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.996636] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.001935] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.002384] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.002582] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.002836] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.003258] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.003393] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.003691] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 881.003898] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.004100] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.004330] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.004525] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 881.004719] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.004938] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.006569] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.006755] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.007335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.007335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.007335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.007625] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.007784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.007885] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.008114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.008248] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.008639] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be deleted. [ 881.029539] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.029539] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 881.029725] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.029863] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.030116] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.030285] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.030477] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.030746] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.031337] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.042908] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.043077] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.043137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.043354] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.043435] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.043531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.303355] env[69637]: INFO networking_nsxv3.common.synchronization [None req-35bf59ef-3f7d-48c3-b707-0a2d006e7f81 None None] Enqueued Resource ID: 50af50c5-da80-43f7-979e-a67d16d557c0 with Priority: HIGHEST for action port [ 881.305962] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50af50c5-da80-43f7-979e-a67d16d557c0 with Priority: HIGHEST for action port [ 881.305962] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-50af50c5-da80-43f7-979e-a67d16d557c0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.305962] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50af50c5-da80-43f7-979e-a67d16d557c0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.305962] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50af50c5-da80-43f7-979e-a67d16d557c0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.305962] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50af50c5-da80-43f7-979e-a67d16d557c0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.305962] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50af50c5-da80-43f7-979e-a67d16d557c0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.335771] env[69637]: INFO networking_nsxv3.common.synchronization [None req-d0f4669b-2f71-4553-823c-4b487aed744d None None] Enqueued Resource ID: fe7efbd4-e470-4404-ab67-9a00a9fc4439 with Priority: HIGHEST for action port [ 881.336305] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7efbd4-e470-4404-ab67-9a00a9fc4439 with Priority: HIGHEST for action port [ 881.336599] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe7efbd4-e470-4404-ab67-9a00a9fc4439 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.336730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe7efbd4-e470-4404-ab67-9a00a9fc4439" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.336778] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe7efbd4-e470-4404-ab67-9a00a9fc4439" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.340210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe7efbd4-e470-4404-ab67-9a00a9fc4439" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.340292] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe7efbd4-e470-4404-ab67-9a00a9fc4439',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.354389] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d in Status: SUCCESS [ 881.354389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.534783] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.535057] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.535057] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.536175] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.536175] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.536175] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16 not found, creating... [ 881.536175] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.536175] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.536720] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.536720] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.536720] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.536935] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.537107] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.537179] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.539330] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.539330] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.539330] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16 is going to be created. [ 881.560892] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 881.562017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.562017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.562017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.562017] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.562017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.562017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.562017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.562304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.562304] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.571975] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.572250] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.572417] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.572726] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.572960] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.573212] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.807129] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50af50c5-da80-43f7-979e-a67d16d557c0 [ 881.807129] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.807831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.807831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.807831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.807831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.807831] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50af50c5-da80-43f7-979e-a67d16d557c0 already deleted. [ 881.807831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50af50c5-da80-43f7-979e-a67d16d557c0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.843842] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe7efbd4-e470-4404-ab67-9a00a9fc4439 [ 881.844892] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.844892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.844892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.844892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.844892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.844892] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe7efbd4-e470-4404-ab67-9a00a9fc4439 already deleted. [ 881.844892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe7efbd4-e470-4404-ab67-9a00a9fc4439" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.064756] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.500018] env[69637]: INFO networking_nsxv3.common.synchronization [req-83489897-7ddf-406b-97e4-9fbf4e97009c req-c12aa63b-115c-40e5-9129-6b8fcc0fba53 service nova] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_rules [ 882.500018] env[69637]: INFO networking_nsxv3.common.synchronization [req-83489897-7ddf-406b-97e4-9fbf4e97009c req-c12aa63b-115c-40e5-9129-6b8fcc0fba53 service nova] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 882.500169] env[69637]: INFO networking_nsxv3.common.synchronization [req-83489897-7ddf-406b-97e4-9fbf4e97009c req-c12aa63b-115c-40e5-9129-6b8fcc0fba53 service nova] Enqueued Resource ID: c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16 with Priority: HIGHEST for action port [ 882.500345] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_rules [ 882.500518] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 882.500622] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16 with Priority: HIGHEST for action port [ 882.504568] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.504568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.504568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.504568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.504568] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.510092] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.510092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.510092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.510092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.510092] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.510092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.510092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.510092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.510092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.510092] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.513246] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.514807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.514807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.514807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.514807] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.570508] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.606570] env[69637]: INFO networking_nsxv3.common.synchronization [None req-c0b5207f-8f92-46f2-b2be-2df99c553c78 tempest-ServersWithSpecificFlavorTestJSON-315105085 tempest-ServersWithSpecificFlavorTestJSON-315105085-project-member] Enqueued Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_rules [ 882.607106] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_rules [ 882.607409] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.607530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.607599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.607849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.607944] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.727216] env[69637]: INFO networking_nsxv3.common.synchronization [None req-bd4f252e-3531-4e68-a38a-52cffff8817d tempest-ServersWithSpecificFlavorTestJSON-315105085 tempest-ServersWithSpecificFlavorTestJSON-315105085-project-member] Enqueued Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_rules [ 882.727876] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_rules [ 882.728313] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.728773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.007988] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.007988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.017022] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.017886] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16 with status ACTIVE [ 883.021027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.021027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.021027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.021027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.021027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.021027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.021027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.021027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.021027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.021027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.021027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.021027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.021027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.021027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.021027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.021027] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16 is going to be updated. [ 883.040902] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.040902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.040902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.040902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.040902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.041161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5e68b0b-f4cb-4aa7-b05e-49c1acee0e16" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.073494] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.073653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.073766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.074020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.074211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.074211] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 883.099124] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.099124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.099124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.099124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.099124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.106733] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 883.203985] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.203985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.203985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.203985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.203985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.203985] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 already deleted. [ 883.203985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.203985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.203985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.203985] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.333418] env[69637]: INFO networking_nsxv3.common.synchronization [None req-c0ecdf9e-1b76-4d66-9b34-f5e00ce895ae None None] Enqueued Resource ID: dda27aab-71ff-4dae-bd3e-945a0e1cc862 with Priority: HIGHEST for action port [ 883.333952] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda27aab-71ff-4dae-bd3e-945a0e1cc862 with Priority: HIGHEST for action port [ 883.334291] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-dda27aab-71ff-4dae-bd3e-945a0e1cc862 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.334422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dda27aab-71ff-4dae-bd3e-945a0e1cc862" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.334494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dda27aab-71ff-4dae-bd3e-945a0e1cc862" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.334799] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dda27aab-71ff-4dae-bd3e-945a0e1cc862" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.334900] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dda27aab-71ff-4dae-bd3e-945a0e1cc862',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.518513] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.728148] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.728148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.728148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.728602] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.728602] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.728602] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 already deleted. [ 883.728602] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.839261] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dda27aab-71ff-4dae-bd3e-945a0e1cc862 [ 883.839261] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.839261] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.839261] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.839261] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.839261] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.839261] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dda27aab-71ff-4dae-bd3e-945a0e1cc862 already deleted. [ 883.839261] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dda27aab-71ff-4dae-bd3e-945a0e1cc862" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.024715] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.024879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.024952] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.025180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.025273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.025370] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be created. [ 884.046405] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.047183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.047183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.047183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.048038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.056101] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: UNINITIALIZED for 2s [ 884.649031] env[69637]: INFO networking_nsxv3.common.synchronization [req-04301bd0-1d93-4aa9-abdc-b1430e31a18f req-387617af-539c-4eae-a87d-be01ed740624 tempest-InstanceActionsV221TestJSON-606614272 tempest-InstanceActionsV221TestJSON-606614272-project-member] Enqueued Resource ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d with Priority: HIGHEST for action security_group_members [ 884.650057] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d with Priority: HIGHEST for action security_group_members [ 884.650653] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.650879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.650949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.651185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.651582] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.651582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.651582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.652105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.652105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.652105] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ff0c3ba-5135-40b4-ae76-b08804b8ec7d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.122366] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 885.122366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.122366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.122366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.122366] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.122366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.122366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.122366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.122366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.122366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.122366] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.154943] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.155028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.155103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.155315] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.155405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.155643] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.155772] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.155887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.155953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.156061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.156166] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d is going to be updated. [ 885.183920] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.183920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.183920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.183920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.183920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.190160] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d in Status: IN_PROGRESS for 2s [ 885.397909] env[69637]: INFO networking_nsxv3.common.synchronization [req-83489897-7ddf-406b-97e4-9fbf4e97009c req-805f1a9d-0730-4ea6-bffc-00da5053b664 tempest-MultipleCreateTestJSON-1546211828 tempest-MultipleCreateTestJSON-1546211828-project-member] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 885.398409] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 885.398711] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.398992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.631049] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.631049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.631049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.631049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.631049] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.631049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.631049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.631049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.631049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.631049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.631049] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.631049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.631049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.631049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.631049] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.631049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.631878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.631878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.631878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.631878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.631878] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.697576] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.697835] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.697994] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.698317] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.698607] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.698798] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.698952] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.700024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.700290] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.701085] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.701302] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.701508] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.701821] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.702063] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.702273] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.702514] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.721703] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.722103] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 885.722720] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.724016] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-628" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.724179] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-21cf3ecf-effb-4966-92b4-954cdcae4d1a taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.724582] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-21cf3ecf-effb-4966-92b4-954cdcae4d1a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.725903] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-21cf3ecf-effb-4966-92b4-954cdcae4d1a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.725903] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-21cf3ecf-effb-4966-92b4-954cdcae4d1a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.725903] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21cf3ecf-effb-4966-92b4-954cdcae4d1a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.066690] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: SUCCESS [ 886.066882] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.067063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.067279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.067474] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.067591] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.067657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.067805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.067885] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.067973] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.068087] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.068939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.069527] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.069687] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.069908] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.069992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.070182] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.070305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.070418] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.133819] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 156f33af-1675-4f7d-b99d-9e88f58f4cd2: rpc.has_security_group_logging(os_id): False [ 886.151150] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.152708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.152708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.152708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.169275] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.169548] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.169761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.169813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.170042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.170141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.170397] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.170504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.170591] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.170759] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.170834] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.171021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.171120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.171181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.171550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.171550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.171550] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 886.229041] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.229041] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.229041] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.229041] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.229041] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.229041] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 21cf3ecf-effb-4966-92b4-954cdcae4d1a not found, creating... [ 886.229041] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.229041] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.229447] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.229447] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.229501] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.229786] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.229942] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.230070] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.230277] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.230408] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.230555] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 21cf3ecf-effb-4966-92b4-954cdcae4d1a is going to be created. [ 886.247041] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.247041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.247041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.247041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.247041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.255160] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.255160] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.255160] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.255160] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.255160] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.255487] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-21cf3ecf-effb-4966-92b4-954cdcae4d1a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.261195] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 886.575121] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.575121] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.575121] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.965361] env[69637]: INFO networking_nsxv3.common.synchronization [req-83489897-7ddf-406b-97e4-9fbf4e97009c req-a08ee022-232c-4910-be90-39ecac4fd08b service nova] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_rules [ 886.965361] env[69637]: INFO networking_nsxv3.common.synchronization [req-83489897-7ddf-406b-97e4-9fbf4e97009c req-a08ee022-232c-4910-be90-39ecac4fd08b service nova] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 886.965361] env[69637]: INFO networking_nsxv3.common.synchronization [req-83489897-7ddf-406b-97e4-9fbf4e97009c req-a08ee022-232c-4910-be90-39ecac4fd08b service nova] Enqueued Resource ID: 21cf3ecf-effb-4966-92b4-954cdcae4d1a with Priority: HIGHEST for action port [ 886.966073] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_rules [ 886.966417] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 886.966777] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21cf3ecf-effb-4966-92b4-954cdcae4d1a with Priority: HIGHEST for action port [ 886.967349] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.968322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.968322] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.968521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.968897] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-21cf3ecf-effb-4966-92b4-954cdcae4d1a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.969973] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21cf3ecf-effb-4966-92b4-954cdcae4d1a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.969973] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21cf3ecf-effb-4966-92b4-954cdcae4d1a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.969973] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21cf3ecf-effb-4966-92b4-954cdcae4d1a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.969973] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21cf3ecf-effb-4966-92b4-954cdcae4d1a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.079224] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.199889] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d in Status: SUCCESS [ 887.199889] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d deletion is rescheduled due to dependency. [ 887.199889] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.320312] env[69637]: INFO networking_nsxv3.common.synchronization [req-2c13ed25-8076-41bb-a9a6-3049370d2815 req-1db1e740-9816-4663-83f3-ec6863e2ee35 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: fefafe98-8990-454a-a252-19be0a2a5042 with Priority: HIGHEST for action security_group_members [ 887.320888] env[69637]: INFO networking_nsxv3.common.synchronization [req-2c13ed25-8076-41bb-a9a6-3049370d2815 req-1db1e740-9816-4663-83f3-ec6863e2ee35 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 887.321918] env[69637]: INFO networking_nsxv3.common.synchronization [req-2c13ed25-8076-41bb-a9a6-3049370d2815 req-1db1e740-9816-4663-83f3-ec6863e2ee35 tempest-SecurityGroupsTestJSON-1209575483 tempest-SecurityGroupsTestJSON-1209575483-project-member] Enqueued Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGHEST for action security_group_members [ 887.322828] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefafe98-8990-454a-a252-19be0a2a5042 with Priority: HIGHEST for action security_group_members [ 887.326224] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGHEST for action security_group_members [ 887.326347] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGHEST for action security_group_members [ 887.326944] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefafe98-8990-454a-a252-19be0a2a5042 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.327088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.327156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.327372] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.327530] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.327628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.327690] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.327834] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.328649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.328649] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefafe98-8990-454a-a252-19be0a2a5042',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.329201] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.329310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.329384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.329917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.330969] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.330969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.330969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.330969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.330969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.330969] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.331805] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad77a84e-935d-4f36-9c82-e497b2b9c639 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.331949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.332058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.332244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.332870] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.332870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.332870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.332870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.332870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.333078] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.472616] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21cf3ecf-effb-4966-92b4-954cdcae4d1a with status ACTIVE [ 887.472716] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.472921] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.472921] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.473358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.473358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.473358] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.473520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.473520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.473713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.473782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.473907] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.474030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.474066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.474200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.474283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.474438] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21cf3ecf-effb-4966-92b4-954cdcae4d1a is going to be updated. [ 887.493788] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.494100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.494100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.494225] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.494330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.494488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21cf3ecf-effb-4966-92b4-954cdcae4d1a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.581973] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.582155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.582230] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.582638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.582638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.583467] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be updated. [ 887.622673] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.622673] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.622673] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.622673] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.622673] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.632407] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: IN_PROGRESS for 2s [ 887.837268] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.837268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.837268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.837268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.837268] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.837268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.837268] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.837268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.867020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.867020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.867020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.867020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.867020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.867020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.867020] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefafe98-8990-454a-a252-19be0a2a5042 is going to be updated. [ 887.867020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.867020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.867020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.867020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.867020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.867020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.868013] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.868359] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.868558] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be updated. [ 887.869945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.870434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.888341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.888590] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.888736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.888808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.889012] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.889570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.889570] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 is going to be updated. [ 887.896708] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.896854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.896914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.897134] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.897276] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.898876] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.899009] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.899111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.899330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.899455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.908149] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefafe98-8990-454a-a252-19be0a2a5042 in Status: IN_PROGRESS for 2s [ 887.908850] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: IN_PROGRESS for 2s [ 887.923043] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.923200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.923271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.923722] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.923890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.931368] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: IN_PROGRESS for 2s [ 888.278144] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 888.278498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.643893] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: SUCCESS [ 889.645253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.645253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.645253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.645253] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.645253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.645253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.645253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.645253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.645253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.645581] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.645581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.645581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.645700] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.646255] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.646255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.646255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.646255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.646255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.646255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.646585] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.647723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.647723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.647723] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.647723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.647723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.647923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.647923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.648514] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.918736] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefafe98-8990-454a-a252-19be0a2a5042 in Status: SUCCESS [ 889.918990] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefafe98-8990-454a-a252-19be0a2a5042 deletion is rescheduled due to dependency. [ 889.919136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefafe98-8990-454a-a252-19be0a2a5042" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.919987] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a in Status: SUCCESS [ 889.920200] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a deletion is rescheduled due to dependency. [ 889.920323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.938992] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 in Status: SUCCESS [ 889.939197] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 deletion is rescheduled due to dependency. [ 889.940635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.150135] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab904195-351a-49c6-8462-7f952d95cf87: rpc.has_security_group_logging(os_id): False [ 890.151469] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.167302] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.167485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.167537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.167779] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.167868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.168119] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.168230] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.168300] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.168433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.168510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.168783] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.168838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.168883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.169070] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.169150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.169362] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.169450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.169511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.169671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.169739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.169828] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be created. [ 890.224484] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.224581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.224711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.224830] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.225035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.237734] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: IN_PROGRESS for 2s [ 890.451337] env[69637]: INFO networking_nsxv3.common.synchronization [req-5ff3a482-bcc9-45a2-979c-2b79e17c262e req-dc2b53ae-70cf-4671-a0a0-ea99b03d311d tempest-ServersTestJSON-1659168521 tempest-ServersTestJSON-1659168521-project-member] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 890.452108] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 890.452164] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.453087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.453087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.453087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.453087] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.453087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.453087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.453087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.453463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.453463] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.654098] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.955885] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.962860] env[69637]: INFO networking_nsxv3.common.synchronization [req-e5e0f3d5-c64c-439c-adc5-d0efcd29df07 req-91bc0f50-92d4-482c-9581-cb95483f69e2 tempest-ServerRescueTestJSON-1328189417 tempest-ServerRescueTestJSON-1328189417-project-member] Enqueued Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_members [ 890.962860] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_members [ 890.962860] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.962860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.962860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.962860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.962860] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.962860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.962860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.962860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.962860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.962860] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.161060] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.161223] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.161291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.161520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.161609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.161701] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be updated. [ 891.193904] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.194060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.194132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.194346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.194496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.204044] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: IN_PROGRESS for 2s [ 891.407950] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-538 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.408234] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-538" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.408394] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-538" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.409035] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-538" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.409403] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.409599] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.409737] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.409995] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.410253] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.410509] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.410631] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.410775] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.410910] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.411088] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.411230] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.411390] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.430344] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.430658] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 891.430658] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.430954] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-538" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.431854] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-739b54b1-831b-49c3-8ef6-54ed902cfaee taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.431854] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-739b54b1-831b-49c3-8ef6-54ed902cfaee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.431854] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-739b54b1-831b-49c3-8ef6-54ed902cfaee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.432071] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-739b54b1-831b-49c3-8ef6-54ed902cfaee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.432247] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('739b54b1-831b-49c3-8ef6-54ed902cfaee',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.460230] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.465212] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.465212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.465212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.465417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.465417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.465911] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.465911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.465911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.465911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.466242] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.466242] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe already deleted. [ 891.466242] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.936923] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.937225] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.937310] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.937584] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.937732] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.937897] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 739b54b1-831b-49c3-8ef6-54ed902cfaee not found, creating... [ 891.938167] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.938324] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.938444] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.938658] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.938911] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.939083] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.939267] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.939389] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.939600] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.939736] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.939877] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 739b54b1-831b-49c3-8ef6-54ed902cfaee is going to be created. [ 891.958387] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.958598] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.958729] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.959029] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.959285] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.959572] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-739b54b1-831b-49c3-8ef6-54ed902cfaee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.962131] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.962374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.962374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.962475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.962554] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.962646] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 891.989850] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.989984] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.990074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.990273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.990410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.998091] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 892.254049] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: SUCCESS [ 892.254284] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.254457] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.254665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.254775] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.720092] env[69637]: INFO networking_nsxv3.common.synchronization [req-e5e0f3d5-c64c-439c-adc5-d0efcd29df07 req-d56662ec-b1e3-47b4-82bc-d1972b7b6e4a service nova] Enqueued Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_rules [ 892.720295] env[69637]: INFO networking_nsxv3.common.synchronization [req-e5e0f3d5-c64c-439c-adc5-d0efcd29df07 req-d56662ec-b1e3-47b4-82bc-d1972b7b6e4a service nova] Enqueued Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_members [ 892.720437] env[69637]: INFO networking_nsxv3.common.synchronization [req-e5e0f3d5-c64c-439c-adc5-d0efcd29df07 req-d56662ec-b1e3-47b4-82bc-d1972b7b6e4a service nova] Enqueued Resource ID: 739b54b1-831b-49c3-8ef6-54ed902cfaee with Priority: HIGHEST for action port [ 892.720687] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_rules [ 892.720782] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_members [ 892.720942] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739b54b1-831b-49c3-8ef6-54ed902cfaee with Priority: HIGHEST for action port [ 892.721526] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f38a6b0-1f81-42d8-9f18-8deb24c569fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.721607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.721707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.721981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.722177] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.723049] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.723208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.723344] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.723538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.723870] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.723870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.723870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.724097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.724226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.724341] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.728019] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-739b54b1-831b-49c3-8ef6-54ed902cfaee taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.728019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-739b54b1-831b-49c3-8ef6-54ed902cfaee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.728019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-739b54b1-831b-49c3-8ef6-54ed902cfaee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.728019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-739b54b1-831b-49c3-8ef6-54ed902cfaee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.728019] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('739b54b1-831b-49c3-8ef6-54ed902cfaee',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.757493] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.757625] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.213534] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: SUCCESS [ 893.213815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.214098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.214331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.214517] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.214963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.215068] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.215244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.215326] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.215418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.215542] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.227669] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.227903] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.228070] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.229049] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 739b54b1-831b-49c3-8ef6-54ed902cfaee with status ACTIVE [ 893.229248] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.229421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.229495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.229740] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.229831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.230098] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.230257] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.230335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.230494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.230620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.230808] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.230955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.231052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.231169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.231514] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.231514] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 739b54b1-831b-49c3-8ef6-54ed902cfaee is going to be updated. [ 893.271667] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.271846] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.271957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.272411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.272411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.272530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-739b54b1-831b-49c3-8ef6-54ed902cfaee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.719482] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.719482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.719482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.719482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.719482] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.719482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.719482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.719806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.719806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.719806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.719923] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.720037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.720078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.720330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.720330] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.720451] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.720451] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.720576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.720642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.720726] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.720813] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.734077] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.752166] env[69637]: INFO networking_nsxv3.common.synchronization [req-e9b6364a-a3d9-4ba6-954b-112dfc9ed14f req-3a5ba400-e910-4e66-a47d-ed0398031625 tempest-ImagesTestJSON-1924392618 tempest-ImagesTestJSON-1924392618-project-member] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 893.752824] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 893.752934] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.753066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.753131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.753322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.753471] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.753563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.753622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.753764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.753844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.753931] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.007648] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 894.007892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.194992] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.195237] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.195366] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.195636] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.195901] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.196087] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.196229] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.196478] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.196627] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.196857] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.196995] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.197138] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.197247] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.197361] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.197470] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.197606] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.216773] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.216773] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 894.216773] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.217067] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.217242] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-f070b50d-ccb9-4e8c-b48f-7791cef2d68e taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.217414] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-f070b50d-ccb9-4e8c-b48f-7791cef2d68e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.217672] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-f070b50d-ccb9-4e8c-b48f-7791cef2d68e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.217848] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-f070b50d-ccb9-4e8c-b48f-7791cef2d68e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.217989] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f070b50d-ccb9-4e8c-b48f-7791cef2d68e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.222944] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab904195-351a-49c6-8462-7f952d95cf87: rpc.has_security_group_logging(os_id): False [ 894.238958] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.239143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.239227] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.239438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.239525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.239622] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe is going to be created. [ 894.241501] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.241620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.241688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.241896] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.241978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.242189] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.242301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.242366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.242534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.242613] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.242838] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.242956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.243040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.243183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.243270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.243456] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.243548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.243608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.243743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.243863] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.243912] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be updated. [ 894.255676] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.265021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.265150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.265220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.265537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.265618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.273904] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe in Status: UNINITIALIZED for 2s [ 894.307882] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.308043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.308117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.308334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.308479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.326519] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: IN_PROGRESS for 2s [ 894.722188] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.722545] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.722695] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.722893] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.723109] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.723350] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port f070b50d-ccb9-4e8c-b48f-7791cef2d68e not found, creating... [ 894.723701] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.724255] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.724255] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.724255] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.724396] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.724658] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.724857] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.724984] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.725228] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.725377] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.725586] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: f070b50d-ccb9-4e8c-b48f-7791cef2d68e is going to be created. [ 894.743263] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.743263] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.743263] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.743476] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.744312] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.744312] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-f070b50d-ccb9-4e8c-b48f-7791cef2d68e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.758185] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.248793] env[69637]: INFO networking_nsxv3.common.synchronization [req-dc044a26-998c-43b6-baa8-88e2440ffc3b req-d4f29c7b-b708-4b6a-84e1-caf2b2234564 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 895.249374] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 895.250220] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.250220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.250220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.250220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.250516] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.250516] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.250516] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.250655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.250655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.250730] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.260650] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.260821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.260869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.261171] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.261283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.261409] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 895.290076] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.290337] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.290459] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.290760] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.291027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.299062] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 895.542477] env[69637]: INFO networking_nsxv3.common.synchronization [req-e9b6364a-a3d9-4ba6-954b-112dfc9ed14f req-c43861c5-893c-4ea6-8325-9f8f9bc5b764 service nova] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_rules [ 895.542792] env[69637]: INFO networking_nsxv3.common.synchronization [req-e9b6364a-a3d9-4ba6-954b-112dfc9ed14f req-c43861c5-893c-4ea6-8325-9f8f9bc5b764 service nova] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 895.543014] env[69637]: INFO networking_nsxv3.common.synchronization [req-e9b6364a-a3d9-4ba6-954b-112dfc9ed14f req-c43861c5-893c-4ea6-8325-9f8f9bc5b764 service nova] Enqueued Resource ID: f070b50d-ccb9-4e8c-b48f-7791cef2d68e with Priority: HIGHEST for action port [ 895.543567] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_rules [ 895.543703] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 895.543799] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f070b50d-ccb9-4e8c-b48f-7791cef2d68e with Priority: HIGHEST for action port [ 895.545649] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.545785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.545852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.546263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.546352] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.547602] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.547709] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.547919] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-f070b50d-ccb9-4e8c-b48f-7791cef2d68e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.548036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f070b50d-ccb9-4e8c-b48f-7791cef2d68e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.548102] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f070b50d-ccb9-4e8c-b48f-7791cef2d68e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.548279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f070b50d-ccb9-4e8c-b48f-7791cef2d68e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.548359] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f070b50d-ccb9-4e8c-b48f-7791cef2d68e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.552360] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-149 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.552567] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.552774] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.553047] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.553331] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.553489] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.553627] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.553886] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.554064] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.558018] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 895.558018] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.558018] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.558018] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.558018] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 895.558018] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.558018] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.572165] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.573165] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 895.573165] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.573165] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.573165] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-c8abbfe0-2cb3-48e2-b116-e0a13c82627f taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.573414] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-c8abbfe0-2cb3-48e2-b116-e0a13c82627f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.573524] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-c8abbfe0-2cb3-48e2-b116-e0a13c82627f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.573885] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-c8abbfe0-2cb3-48e2-b116-e0a13c82627f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.574261] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8abbfe0-2cb3-48e2-b116-e0a13c82627f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.753411] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.753574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.753638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.753870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.773035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.773035] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.773035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.773035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.773289] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.773289] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.773353] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be updated. [ 895.795404] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.795587] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.795705] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.795869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.796027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.804696] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 896.054475] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f070b50d-ccb9-4e8c-b48f-7791cef2d68e with status ACTIVE [ 896.054475] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.054475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.054475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.054475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.054475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.054475] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.054475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.054475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.054475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.054475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.054475] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.054475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.054475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.054475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.054475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.054475] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f070b50d-ccb9-4e8c-b48f-7791cef2d68e is going to be updated. [ 896.055742] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.056121] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.074785] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.077256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.077256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.077256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.077256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.077256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f070b50d-ccb9-4e8c-b48f-7791cef2d68e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.079179] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.079179] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.079179] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.079440] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.079440] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.079597] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port c8abbfe0-2cb3-48e2-b116-e0a13c82627f not found, creating... [ 896.079897] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.079986] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.080053] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.080277] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.080410] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.080681] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.080839] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.080959] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.081195] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.081325] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.081492] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: c8abbfe0-2cb3-48e2-b116-e0a13c82627f is going to be created. [ 896.099273] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.099655] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.099655] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.100187] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.100187] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.100424] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-c8abbfe0-2cb3-48e2-b116-e0a13c82627f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.283136] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe in Status: SUCCESS [ 896.283464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.284030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.284030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.284030] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.284232] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.284232] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.284345] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.284428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.284513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.284611] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.343981] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: SUCCESS [ 896.344169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.787914] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.788084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.788133] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.788336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.788940] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.789103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.789165] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.789332] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.789420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.789511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.789665] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.789764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.789824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.789965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.790121] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.790213] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.790269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.790407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.790484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.790565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.790652] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.805642] env[69637]: INFO networking_nsxv3.common.synchronization [req-dc044a26-998c-43b6-baa8-88e2440ffc3b req-b90a6110-9572-4a7e-ba56-bc4e60ca8fe9 service nova] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_rules [ 896.805873] env[69637]: INFO networking_nsxv3.common.synchronization [req-dc044a26-998c-43b6-baa8-88e2440ffc3b req-b90a6110-9572-4a7e-ba56-bc4e60ca8fe9 service nova] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 896.806039] env[69637]: INFO networking_nsxv3.common.synchronization [req-dc044a26-998c-43b6-baa8-88e2440ffc3b req-b90a6110-9572-4a7e-ba56-bc4e60ca8fe9 service nova] Enqueued Resource ID: c8abbfe0-2cb3-48e2-b116-e0a13c82627f with Priority: HIGHEST for action port [ 896.806271] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_rules [ 896.806426] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 896.806493] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8abbfe0-2cb3-48e2-b116-e0a13c82627f with Priority: HIGHEST for action port [ 896.808699] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.808887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.808962] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.809190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.809613] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.813647] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.813647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.813647] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8abbfe0-2cb3-48e2-b116-e0a13c82627f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.813647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8abbfe0-2cb3-48e2-b116-e0a13c82627f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.813647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8abbfe0-2cb3-48e2-b116-e0a13c82627f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.813647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8abbfe0-2cb3-48e2-b116-e0a13c82627f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.813647] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8abbfe0-2cb3-48e2-b116-e0a13c82627f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.293148] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f38a6b0-1f81-42d8-9f18-8deb24c569fe: rpc.has_security_group_logging(os_id): False [ 897.307699] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 897.307950] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.308169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.308383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.308575] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.308689] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.308754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.308898] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.308997] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.309102] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.310626] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.310737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.310800] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.310955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.311054] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.311240] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.311335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.311394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.311534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.311609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.311779] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.311873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.311932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.312078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.312154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.312333] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.312423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.312480] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.312613] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.312688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.312781] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe is going to be created. [ 897.313802] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.313888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.314587] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8abbfe0-2cb3-48e2-b116-e0a13c82627f with status ACTIVE [ 897.315606] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.315606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.315606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.315606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.315606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.315606] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.315606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.315606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.316057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.316057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.316057] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.316057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.316057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.316221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.316221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.316319] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8abbfe0-2cb3-48e2-b116-e0a13c82627f is going to be updated. [ 897.332693] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.332693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.332693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.332693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.334178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.334178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8abbfe0-2cb3-48e2-b116-e0a13c82627f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.364241] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.364371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.364371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.364554] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.364734] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.376643] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe in Status: IN_PROGRESS for 2s [ 897.815457] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.817509] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 897.817734] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f deletion is rescheduled due to dependency. [ 897.817903] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.818135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.818437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.818677] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.818956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.818956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.819190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.819326] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.819454] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.321615] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.322746] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.567859] env[69637]: INFO networking_nsxv3.common.synchronization [req-1d5ec28d-8fef-4fc4-bc63-423571593558 req-d5017212-a0ee-4876-98de-2d06d00e6a03 tempest-ServerActionsTestOtherA-1708466346 tempest-ServerActionsTestOtherA-1708466346-project-member] Enqueued Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_members [ 898.568163] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_members [ 898.568460] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.568577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.568637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.568883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.571254] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.572109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.572109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.572190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.572281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.572379] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.825901] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.826350] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.826498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.826581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.826786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.826874] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.826974] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 898.860416] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.860645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.860711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.860977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.861211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.883100] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 899.075924] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.076137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.076179] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.076419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.076510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.076710] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.076807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.076880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.077022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.077096] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.077185] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 already deleted. [ 899.077290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.313014] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-310 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.313241] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.313301] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.313615] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.313976] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.314816] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.314816] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.315203] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.315519] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.316013] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.316013] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.316340] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.316340] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.316437] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.316584] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.316779] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.332279] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.332610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.332610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.332725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.332815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.332912] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be updated. [ 899.335808] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.335808] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.335985] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.336195] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.336532] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-27759321-ebd4-4395-a292-9598bc84dc18 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.336727] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-27759321-ebd4-4395-a292-9598bc84dc18" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.336850] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-27759321-ebd4-4395-a292-9598bc84dc18" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.337182] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-27759321-ebd4-4395-a292-9598bc84dc18" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.337330] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27759321-ebd4-4395-a292-9598bc84dc18',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.370402] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.370624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.370737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.371063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.371395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.384694] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 899.388925] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe in Status: SUCCESS [ 899.389292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.840342] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.845240] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.845240] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.845240] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.845240] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.845240] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 27759321-ebd4-4395-a292-9598bc84dc18 not found, creating... [ 899.845240] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.845240] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.845240] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.845240] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.845240] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.845858] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.846305] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.848865] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.848865] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.848865] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.848865] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 27759321-ebd4-4395-a292-9598bc84dc18 is going to be created. [ 899.869200] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.869517] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.869727] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.870185] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.870557] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.870931] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-27759321-ebd4-4395-a292-9598bc84dc18" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.218440] env[69637]: INFO networking_nsxv3.common.synchronization [req-331c547b-27fa-4159-a16c-856d51436311 req-8d1de434-2c7e-46bb-8cda-62773575aa7e tempest-MultipleCreateTestJSON-1546211828 tempest-MultipleCreateTestJSON-1546211828-project-member] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 900.219123] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 900.219358] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.219500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.219568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.219771] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.219922] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.220175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.220253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.220414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.220505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.220611] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.686839] env[69637]: INFO networking_nsxv3.common.synchronization [req-1d5ec28d-8fef-4fc4-bc63-423571593558 req-a0fa00ba-4608-468a-90c4-33312d83e861 service nova] Enqueued Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_rules [ 900.686839] env[69637]: INFO networking_nsxv3.common.synchronization [req-1d5ec28d-8fef-4fc4-bc63-423571593558 req-a0fa00ba-4608-468a-90c4-33312d83e861 service nova] Enqueued Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_members [ 900.686839] env[69637]: INFO networking_nsxv3.common.synchronization [req-1d5ec28d-8fef-4fc4-bc63-423571593558 req-a0fa00ba-4608-468a-90c4-33312d83e861 service nova] Enqueued Resource ID: 27759321-ebd4-4395-a292-9598bc84dc18 with Priority: HIGHEST for action port [ 900.686839] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_rules [ 900.686839] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_members [ 900.686839] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27759321-ebd4-4395-a292-9598bc84dc18 with Priority: HIGHEST for action port [ 900.690634] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.690634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.690634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.690634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.690634] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.690634] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.690634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.690634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.690634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.690634] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.690634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.690634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.690634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.690634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.690634] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.694330] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-27759321-ebd4-4395-a292-9598bc84dc18 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.694330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27759321-ebd4-4395-a292-9598bc84dc18" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.694330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27759321-ebd4-4395-a292-9598bc84dc18" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.694330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27759321-ebd4-4395-a292-9598bc84dc18" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.694330] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27759321-ebd4-4395-a292-9598bc84dc18',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.723658] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.892578] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 900.892738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.892972] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.893102] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.893301] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.893426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.893495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.893648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.893729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.893810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.893899] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.963633] env[69637]: INFO networking_nsxv3.common.synchronization [req-918d7b47-5172-4893-bddf-207e6911edf9 req-33e4261a-5014-471f-8743-4344b7a1c5f9 tempest-MultipleCreateTestJSON-1546211828 tempest-MultipleCreateTestJSON-1546211828-project-member] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 900.964635] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGHEST for action security_group_members [ 900.965056] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.965174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.195244] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.195385] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.195579] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.196984] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27759321-ebd4-4395-a292-9598bc84dc18 with status ACTIVE [ 901.196984] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.196984] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.196984] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.197159] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.197189] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.197354] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.197496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.197530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.197659] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.197737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.197918] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.198015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.198138] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.198378] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.198455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.198539] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27759321-ebd4-4395-a292-9598bc84dc18 is going to be updated. [ 901.222796] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.222796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.222796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.222796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.222796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.222796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27759321-ebd4-4395-a292-9598bc84dc18" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.225283] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.398583] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 901.398583] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.398583] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.398583] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.398814] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.398947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.399403] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.399403] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.399588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.399717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.399838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.399971] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.400205] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.400384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.400452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.401500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.401500] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.401500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.401500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.401500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.401500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.401500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.401746] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.403614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.403997] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.404296] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.404480] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.404601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.404831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.404964] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.405748] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.405748] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.700764] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.729265] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.729618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.729618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.729757] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.729805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.729900] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be updated. [ 901.759840] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.760521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.760614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.760854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.761041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.769585] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: IN_PROGRESS for 2s [ 901.905737] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc8c512a-6092-4e87-9d42-efdd0a8ab3f4: rpc.has_security_group_logging(os_id): False [ 901.910873] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.910873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.910873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.910873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.910873] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.910873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.910873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.910873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.910873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.910873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.910873] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.910873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.910873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.910873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.910873] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.910873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.911455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.911455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.911455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.911455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.911455] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.922182] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.922490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.922641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.922909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.943031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.943194] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.943277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.943350] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.943505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.943614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.943934] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.944068] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.944109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.944270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.944352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.944657] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.945533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.945533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.945652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.945652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.945743] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 902.006245] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.006434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.006491] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.006679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.006837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.023556] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 902.207675] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.207675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.207675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.207675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.207675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.207675] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 is going to be created. [ 902.251305] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.251471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.251537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.251748] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.251918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.266612] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 in Status: UNINITIALIZED for 2s [ 902.415284] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f55a00f-c3f8-407e-be41-257b4c01874f: rpc.has_security_group_logging(os_id): False [ 902.432785] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.433143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.433143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.433224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.433320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.433510] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.433609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.433672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.433821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.433897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.434112] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.434211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.434273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.434409] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.434563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.434655] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.434748] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.434826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.434964] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.436063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.436247] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be updated. [ 902.451062] env[69637]: INFO networking_nsxv3.common.synchronization [None req-e715380a-0197-4f11-b2fe-2d04518dae44 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 902.453709] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 902.454805] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.455086] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.455219] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.455614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.455819] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.455974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.456117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.456366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.456506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.456644] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.503812] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.503960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.504053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.504256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.504433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.517757] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 902.962490] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.280309] env[69637]: INFO networking_nsxv3.common.synchronization [None req-71fd77bd-66b6-4219-a0d3-e1180ce5e484 None None] Enqueued Resource ID: 291d66b4-02a2-4ffd-a00e-9fb9602c0ef8 with Priority: HIGHEST for action port [ 903.280592] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 291d66b4-02a2-4ffd-a00e-9fb9602c0ef8 with Priority: HIGHEST for action port [ 903.281200] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-291d66b4-02a2-4ffd-a00e-9fb9602c0ef8 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.281367] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-291d66b4-02a2-4ffd-a00e-9fb9602c0ef8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.281452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-291d66b4-02a2-4ffd-a00e-9fb9602c0ef8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.281631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-291d66b4-02a2-4ffd-a00e-9fb9602c0ef8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.281711] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('291d66b4-02a2-4ffd-a00e-9fb9602c0ef8',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.464527] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.627854] env[69637]: INFO networking_nsxv3.common.synchronization [req-65e95443-3403-41f1-aa33-38974055efe5 req-d33063de-1e34-478a-8990-cfc4a5f255ca tempest-ServersAdminTestJSON-567435686 tempest-ServersAdminTestJSON-567435686-project-member] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 903.628647] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 903.629174] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.629174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.629310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.629446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.629816] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.629926] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.629991] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.630173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.630263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.630361] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.786977] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: SUCCESS [ 903.787216] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.787472] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 291d66b4-02a2-4ffd-a00e-9fb9602c0ef8 [ 903.787697] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.787817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.787881] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.788097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.788173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.788285] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:291d66b4-02a2-4ffd-a00e-9fb9602c0ef8 already deleted. [ 903.788368] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-291d66b4-02a2-4ffd-a00e-9fb9602c0ef8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.788499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.788643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.788788] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.788884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.788943] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.790345] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.790437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.790540] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.966859] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.967141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.967141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.967411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.967525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.967622] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be updated. [ 904.005658] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.006747] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.007351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.010120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.010390] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.019423] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 904.037647] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 904.037871] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.134405] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.276819] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 in Status: SUCCESS [ 904.278093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.278093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.278093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.278093] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.278093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.278093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.278093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.278427] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.278427] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.278427] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.295256] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.295256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.295256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.295256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.295256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.295256] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.295256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.295256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.295256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.295256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.295256] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be updated. [ 904.325419] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.325419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.325419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.325419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.325419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.334014] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: IN_PROGRESS for 2s [ 904.542032] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 904.542032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.642543] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.785715] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.785715] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.786185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.786185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.786253] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.786304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.787290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.787290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.787290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.787290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.787290] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.787290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.787290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.787290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.787656] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.787656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.787656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.787656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.787778] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.787778] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.789031] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.836549] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-149 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.836856] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.836931] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.837217] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.837499] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.837675] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.837838] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.838397] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.838483] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.838727] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.838846] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.839132] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.839132] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.839229] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.839306] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.839454] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.864446] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.864642] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 904.864789] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.864968] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.865471] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.865679] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.865799] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.866349] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.866616] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.143838] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.144319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.144319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.144595] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.144699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.144814] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 is going to be updated. [ 905.182382] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.182617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.182662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.182939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.183183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.200622] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: IN_PROGRESS for 2s [ 905.294708] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b978e6a-7c34-4af8-a48f-77dd3db23234: rpc.has_security_group_logging(os_id): False [ 905.315354] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.315703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.315703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.315903] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.316041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.316322] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.316588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.316588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.316818] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.316818] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.317241] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.317241] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.317393] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.317770] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.317770] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.317770] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.317913] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.317946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.318240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.318745] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.318745] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 is going to be created. [ 905.369703] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.369703] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.370284] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.370284] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.370284] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.370545] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9 not found, creating... [ 905.371060] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.371274] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.371414] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.371686] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.371860] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.372309] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.379034] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.379034] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.379034] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.379034] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.379034] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9 is going to be created. [ 905.387759] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.387759] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.387759] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.387759] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.387759] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.417025] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 in Status: IN_PROGRESS for 2s [ 905.417025] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.417025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.417025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.417025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.417025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.417025] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.586953] env[69637]: INFO networking_nsxv3.common.synchronization [None req-eb5e649d-f6f4-4506-a5f6-e77726c4e758 tempest-ServersTestFqdnHostnames-1313009998 tempest-ServersTestFqdnHostnames-1313009998-project-member] Enqueued Resource ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 with Priority: HIGHEST for action security_group_rules [ 905.586953] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 with Priority: HIGHEST for action security_group_rules [ 905.586953] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23bbf0c1-9856-41c8-b206-759ddb9f7695 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.586953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.586953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.586953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.586953] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23bbf0c1-9856-41c8-b206-759ddb9f7695',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.740899] env[69637]: INFO networking_nsxv3.common.synchronization [None req-e52ba788-a4e8-4083-a0e3-38bd7af2aa17 tempest-ServersTestFqdnHostnames-1313009998 tempest-ServersTestFqdnHostnames-1313009998-project-member] Enqueued Resource ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 with Priority: HIGHEST for action security_group_rules [ 905.741739] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 with Priority: HIGHEST for action security_group_rules [ 905.743588] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23bbf0c1-9856-41c8-b206-759ddb9f7695 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.743588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.971484] env[69637]: INFO networking_nsxv3.common.synchronization [None req-d283e43b-c5d0-437d-9a7e-a9f50d53ffd2 None None] Enqueued Resource ID: 677b5341-da89-4b6c-ad0b-0547af9e43d1 with Priority: HIGHEST for action port [ 905.972407] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 677b5341-da89-4b6c-ad0b-0547af9e43d1 with Priority: HIGHEST for action port [ 905.972727] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-677b5341-da89-4b6c-ad0b-0547af9e43d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.972849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-677b5341-da89-4b6c-ad0b-0547af9e43d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.972916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-677b5341-da89-4b6c-ad0b-0547af9e43d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.973432] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-677b5341-da89-4b6c-ad0b-0547af9e43d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.974021] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('677b5341-da89-4b6c-ad0b-0547af9e43d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.029473] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 906.029561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.108743] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.108743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.108902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.110015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.110015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.110015] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 already deleted. [ 906.110015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.110015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.110015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.110015] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23bbf0c1-9856-41c8-b206-759ddb9f7695',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.224642] env[69637]: INFO networking_nsxv3.common.synchronization [req-2d828728-3cb5-4d75-92d0-c74537d15f3b req-9235363c-471f-450f-a2aa-f472681deb47 service nova] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_rules [ 906.224642] env[69637]: INFO networking_nsxv3.common.synchronization [req-2d828728-3cb5-4d75-92d0-c74537d15f3b req-9235363c-471f-450f-a2aa-f472681deb47 service nova] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 906.224642] env[69637]: INFO networking_nsxv3.common.synchronization [req-2d828728-3cb5-4d75-92d0-c74537d15f3b req-9235363c-471f-450f-a2aa-f472681deb47 service nova] Enqueued Resource ID: 9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9 with Priority: HIGHEST for action port [ 906.224642] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_rules [ 906.224642] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 906.224642] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9 with Priority: HIGHEST for action port [ 906.224642] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.224642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.224642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.224642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.224642] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.224642] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.224642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.224642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.224642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.224642] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.224642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.224642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.224642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.224642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.225502] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.225502] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.225502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.225502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.225502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.225502] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.345507] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab904195-351a-49c6-8462-7f952d95cf87 in Status: SUCCESS [ 906.345705] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab904195-351a-49c6-8462-7f952d95cf87 deletion is rescheduled due to dependency. [ 906.345829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.478464] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 677b5341-da89-4b6c-ad0b-0547af9e43d1 [ 906.478710] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.478875] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.478949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.479229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.479375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.479485] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:677b5341-da89-4b6c-ad0b-0547af9e43d1 already deleted. [ 906.479594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-677b5341-da89-4b6c-ad0b-0547af9e43d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.633037] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.633343] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.633490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.633807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.633999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.634148] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 already deleted. [ 906.634315] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.726223] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.727347] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.727478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.727692] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9 with status ACTIVE [ 906.727861] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.728026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.728115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.728343] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.728466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.728639] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.728738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.728800] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.728960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.729169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.729359] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.729468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.729507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.729697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.729981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.729981] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9 is going to be updated. [ 906.759817] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.760026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.760078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.760299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.760459] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.760641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f3ecc5b-68e2-4c48-98bc-52f5219fc5c9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.212070] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: SUCCESS [ 907.212333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.233401] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.420873] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 in Status: SUCCESS [ 907.421850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.734566] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.734813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.734880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.735118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.735229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.735335] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be updated. [ 907.778492] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.778650] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.778728] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.779014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.779174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.795737] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 909.640359] env[69637]: INFO networking_nsxv3.common.synchronization [req-3e8b7f00-0068-4fb7-bbfe-5c5e69d3e116 req-28164158-f9bc-4fba-a694-0d43f347f8ab tempest-VolumesAdminNegativeTest-82035611 tempest-VolumesAdminNegativeTest-82035611-project-member] Enqueued Resource ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e with Priority: HIGHEST for action security_group_members [ 909.640875] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e with Priority: HIGHEST for action security_group_members [ 909.641434] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.641434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.641434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.641641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.641778] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.641875] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.641928] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.642104] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.642216] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.642313] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb74dbe6-1fe7-4183-b9a2-aad8d748259e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.805503] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 909.805723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.805883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.806119] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.806312] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.806424] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.806484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.806635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.806716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.806801] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.806892] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.075024] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-234 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.075024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.075024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.075024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.075537] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.075869] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.076137] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.076617] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.077258] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.077258] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.077428] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.077428] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.077575] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.077729] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.077845] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.077978] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.095818] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.095989] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 910.096157] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.096348] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.096662] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-ca315648-ac0d-414f-b170-73994aa6895e taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.096834] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-ca315648-ac0d-414f-b170-73994aa6895e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.096957] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-ca315648-ac0d-414f-b170-73994aa6895e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.097336] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-ca315648-ac0d-414f-b170-73994aa6895e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.097505] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca315648-ac0d-414f-b170-73994aa6895e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.144872] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.145115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.145300] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.145565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.145670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.145887] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.145989] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.146066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.146235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.146318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.146405] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e already deleted. [ 910.146488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.311935] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.312143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.312218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.312441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.312599] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.313051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.313051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.313051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.313051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.313051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.313253] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.313298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.313337] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.313482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.313616] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.313705] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.313766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.313900] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.313978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.314065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.314154] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.600171] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.600863] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.600863] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.600863] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.601053] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.601678] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port ca315648-ac0d-414f-b170-73994aa6895e not found, creating... [ 910.601678] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.601678] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.601678] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.601896] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.601994] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.602289] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.602449] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.602576] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.602791] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.602932] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.603085] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: ca315648-ac0d-414f-b170-73994aa6895e is going to be created. [ 910.622372] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.622575] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.622701] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.622967] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.623255] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.623459] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-ca315648-ac0d-414f-b170-73994aa6895e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.817095] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f55a00f-c3f8-407e-be41-257b4c01874f: rpc.has_security_group_logging(os_id): False [ 910.837516] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.837658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.837730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.837936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.838148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.838283] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.838647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.838647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.838647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.838647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.838812] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.839186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.839186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.839186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.839186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.839395] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.839395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.839499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.839632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.841608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.841608] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be updated. [ 910.898730] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.898894] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.898965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.899200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.899348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.914501] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 911.494367] env[69637]: INFO networking_nsxv3.common.synchronization [req-3e8b7f00-0068-4fb7-bbfe-5c5e69d3e116 req-36d8ccac-afea-4618-8a36-2de4cf8b714e service nova] Enqueued Resource ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e with Priority: HIGHEST for action security_group_rules [ 911.494651] env[69637]: INFO networking_nsxv3.common.synchronization [req-3e8b7f00-0068-4fb7-bbfe-5c5e69d3e116 req-36d8ccac-afea-4618-8a36-2de4cf8b714e service nova] Enqueued Resource ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e with Priority: HIGHEST for action security_group_members [ 911.494651] env[69637]: INFO networking_nsxv3.common.synchronization [req-3e8b7f00-0068-4fb7-bbfe-5c5e69d3e116 req-36d8ccac-afea-4618-8a36-2de4cf8b714e service nova] Enqueued Resource ID: ca315648-ac0d-414f-b170-73994aa6895e with Priority: HIGHEST for action port [ 911.495095] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e with Priority: HIGHEST for action security_group_rules [ 911.495356] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e with Priority: HIGHEST for action security_group_members [ 911.495475] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca315648-ac0d-414f-b170-73994aa6895e with Priority: HIGHEST for action port [ 911.499929] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb74dbe6-1fe7-4183-b9a2-aad8d748259e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.499929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.499929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.499929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.499929] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb74dbe6-1fe7-4183-b9a2-aad8d748259e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.500796] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.500914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.500980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.501172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.501322] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.501571] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.501571] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.502044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.502044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.502044] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb74dbe6-1fe7-4183-b9a2-aad8d748259e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.506550] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca315648-ac0d-414f-b170-73994aa6895e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.506550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca315648-ac0d-414f-b170-73994aa6895e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.506550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca315648-ac0d-414f-b170-73994aa6895e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.506550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca315648-ac0d-414f-b170-73994aa6895e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.506550] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca315648-ac0d-414f-b170-73994aa6895e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.007934] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.007934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.007934] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb74dbe6-1fe7-4183-b9a2-aad8d748259e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.008934] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca315648-ac0d-414f-b170-73994aa6895e with status ACTIVE [ 912.009140] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.009256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.009322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.009528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.009610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.009775] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.009864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.009929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.011697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.011883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.012017] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.012574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.012574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.012574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.012574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.012574] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca315648-ac0d-414f-b170-73994aa6895e is going to be updated. [ 912.035648] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.035648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.035648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.035648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.035883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.035986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca315648-ac0d-414f-b170-73994aa6895e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.510915] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb74dbe6-1fe7-4183-b9a2-aad8d748259e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.934513] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 912.934513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.014585] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.014895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.014895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.015084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.015188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.015355] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e is going to be created. [ 913.039489] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.039489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.039489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.039694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.039817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.049824] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e in Status: UNINITIALIZED for 2s [ 915.061051] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e in Status: SUCCESS [ 915.061355] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.061464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.061674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.061870] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.062096] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.062096] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.062202] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.062277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.062360] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.062464] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb74dbe6-1fe7-4183-b9a2-aad8d748259e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.568080] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.568080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.568080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.568080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.568080] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.568080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.568080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.568080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.568080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.568080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.568080] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.568080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.568080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.569092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.569405] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.571191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.571191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.571191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.571191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.571191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.571191] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb74dbe6-1fe7-4183-b9a2-aad8d748259e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.074523] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb74dbe6-1fe7-4183-b9a2-aad8d748259e: rpc.has_security_group_logging(os_id): False [ 916.094022] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.094022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.094022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.094022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.094022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.094022] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.094022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.094022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.094022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.094022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.094022] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.094022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.094022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.094022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.094022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.094764] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.094764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.094764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.094764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.094764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.094764] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e is going to be created. [ 916.153156] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.153156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.153156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.153156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.153156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.162550] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e in Status: IN_PROGRESS for 2s [ 916.496623] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 916.496728] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 916.767738] env[69637]: INFO networking_nsxv3.common.synchronization [req-597cd4ef-467d-4d5f-9ead-eae312fb1f7c req-f46de3a2-97e1-4bf5-bb25-713e4d2d0fd9 tempest-ImagesTestJSON-1924392618 tempest-ImagesTestJSON-1924392618-project-member] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 916.767738] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 916.767738] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.767738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.767914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.768022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.768935] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.768935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.768935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.768935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.768935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.768935] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.272316] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.435237] env[69637]: INFO networking_nsxv3.common.synchronization [req-ddd26c7d-b93c-4c72-9fbd-d6d45e911055 req-b7f21ea9-b45f-4fea-a36e-b264623c4fd2 tempest-ServerPasswordTestJSON-1575499980 tempest-ServerPasswordTestJSON-1575499980-project-member] Enqueued Resource ID: fff10d50-5957-443e-a8f3-dc5ad9677624 with Priority: HIGHEST for action security_group_members [ 917.436100] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff10d50-5957-443e-a8f3-dc5ad9677624 with Priority: HIGHEST for action security_group_members [ 917.436805] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff10d50-5957-443e-a8f3-dc5ad9677624 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.437496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.440656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.440656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.440656] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.440656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.440656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.440656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.440656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.440656] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fff10d50-5957-443e-a8f3-dc5ad9677624',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.777018] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.942009] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.942186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.942259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.942473] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.942566] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.942763] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.942862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.942925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.943081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.943156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.943239] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fff10d50-5957-443e-a8f3-dc5ad9677624 already deleted. [ 917.943318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.960920] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.961067] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-57" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.961187] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-57" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.961520] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-57" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.962376] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.962376] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.962376] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.962376] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.962587] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.962700] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.962806] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.962910] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.963031] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.963185] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.963294] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.963446] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.985507] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.985701] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 917.985848] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.986032] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-57" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.986336] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.986527] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.986657] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.986974] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.987211] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.173906] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e in Status: SUCCESS [ 918.174167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.279400] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.279704] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.279704] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.279907] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.280012] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.280116] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 918.304941] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.305063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.305128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.305310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.305479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.315936] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 918.489720] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.489853] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.490037] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.490289] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.490428] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.490589] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d not found, creating... [ 918.490852] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.491022] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.491141] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.491363] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.491664] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.491776] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.491934] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.492066] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.492280] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.492417] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.492571] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d is going to be created. [ 918.512024] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.512024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.512024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.512024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.512024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.512378] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.296568] env[69637]: INFO networking_nsxv3.common.synchronization [req-ddd26c7d-b93c-4c72-9fbd-d6d45e911055 req-18e72722-39a6-44fb-9d6b-c0f07d5e0e04 service nova] Enqueued Resource ID: fff10d50-5957-443e-a8f3-dc5ad9677624 with Priority: HIGHEST for action security_group_rules [ 919.296568] env[69637]: INFO networking_nsxv3.common.synchronization [req-ddd26c7d-b93c-4c72-9fbd-d6d45e911055 req-18e72722-39a6-44fb-9d6b-c0f07d5e0e04 service nova] Enqueued Resource ID: fff10d50-5957-443e-a8f3-dc5ad9677624 with Priority: HIGHEST for action security_group_members [ 919.296568] env[69637]: INFO networking_nsxv3.common.synchronization [req-ddd26c7d-b93c-4c72-9fbd-d6d45e911055 req-18e72722-39a6-44fb-9d6b-c0f07d5e0e04 service nova] Enqueued Resource ID: 7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d with Priority: HIGHEST for action port [ 919.296568] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff10d50-5957-443e-a8f3-dc5ad9677624 with Priority: HIGHEST for action security_group_rules [ 919.296568] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff10d50-5957-443e-a8f3-dc5ad9677624 with Priority: HIGHEST for action security_group_members [ 919.296568] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d with Priority: HIGHEST for action port [ 919.296568] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fff10d50-5957-443e-a8f3-dc5ad9677624 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.297041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.297041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.297041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.297041] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fff10d50-5957-443e-a8f3-dc5ad9677624',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.297849] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff10d50-5957-443e-a8f3-dc5ad9677624 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.297970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.298031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.298210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.298394] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.298474] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.298509] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.298628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.298708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.298793] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fff10d50-5957-443e-a8f3-dc5ad9677624',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.300954] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.301069] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.301139] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.301307] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.301360] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.803159] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fff10d50-5957-443e-a8f3-dc5ad9677624',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.804692] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff10d50-5957-443e-a8f3-dc5ad9677624 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.804692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.804692] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d with status ACTIVE [ 919.804692] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.804933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.804933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.805017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.806103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.806103] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.806103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.806103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.806103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.806103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.806103] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.806103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.806103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.806525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.806525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.806525] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d is going to be updated. [ 919.826337] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.826337] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.826337] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.826337] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.826611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.826611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d9a172f-5fdb-45f1-bc47-13b5e9ae1c7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.098232] env[69637]: INFO networking_nsxv3.common.synchronization [req-943e97e2-4d8b-455a-8c7c-4033ddc43058 req-2b674d7b-b726-44dc-977e-05aa14977202 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 920.099661] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 920.099957] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.100098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.100166] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.100372] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.100676] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.100770] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.100857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.100984] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.101083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.101180] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.308853] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fff10d50-5957-443e-a8f3-dc5ad9677624',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.327067] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 920.327700] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.603023] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.811834] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.811991] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.812075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.812442] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.812442] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.812539] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fff10d50-5957-443e-a8f3-dc5ad9677624 is going to be created. [ 920.836872] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.837036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.837112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.837322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.837488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.846024] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fff10d50-5957-443e-a8f3-dc5ad9677624 in Status: UNINITIALIZED for 2s [ 920.938276] env[69637]: INFO networking_nsxv3.common.synchronization [None req-c27b799e-3ff2-4581-bcac-9bdae72c43c5 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 920.938860] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 920.939176] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.939279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.106685] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.610188] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.610588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.610588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.610837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.610985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.611160] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be updated. [ 921.637888] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.637888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.637888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.637888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.637888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.648214] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 922.856222] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fff10d50-5957-443e-a8f3-dc5ad9677624 in Status: SUCCESS [ 922.856517] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.856676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.856860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.857062] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.857210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.857312] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.857613] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.857699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.857740] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.857842] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fff10d50-5957-443e-a8f3-dc5ad9677624',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.361977] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff10d50-5957-443e-a8f3-dc5ad9677624 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.361977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.361977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.361977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.361977] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.361977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.361977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.361977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.361977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.361977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.361977] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff10d50-5957-443e-a8f3-dc5ad9677624 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.361977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.361977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.361977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.361977] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.361977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.362683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.362683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.362683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.362683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.362683] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fff10d50-5957-443e-a8f3-dc5ad9677624',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.411887] env[69637]: INFO networking_nsxv3.common.synchronization [req-3a1f406c-263b-49d8-8831-86a5c599f66b req-f7315006-3106-4ca2-95e5-ef0be8029583 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 1236a1fa-0205-4a17-909f-c8686b475a69 with Priority: HIGHEST for action security_group_members [ 923.412441] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1236a1fa-0205-4a17-909f-c8686b475a69 with Priority: HIGHEST for action security_group_members [ 923.412768] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-1236a1fa-0205-4a17-909f-c8686b475a69 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.412894] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.412965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.413175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.413326] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.413420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.413527] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.413622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.413709] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.413802] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1236a1fa-0205-4a17-909f-c8686b475a69',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.657091] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 923.657856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.658163] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.659884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.659884] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.659884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.659884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.659884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.659884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.659884] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.864587] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fff10d50-5957-443e-a8f3-dc5ad9677624: rpc.has_security_group_logging(os_id): False [ 923.883500] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.883500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.883500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.883500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.883500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.883500] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.883500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.883500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.883500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.883500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.883500] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.883500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.883500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.883986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.883986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.883986] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.884186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.884294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.884446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.887384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.887384] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fff10d50-5957-443e-a8f3-dc5ad9677624 is going to be created. [ 923.921605] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.921605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.921605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.921605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.921605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.921605] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.921605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.921605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.921605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.921605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.921605] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1236a1fa-0205-4a17-909f-c8686b475a69 is going to be updated. [ 923.946018] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.946018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.946018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.946018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.946018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.950658] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.950658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.950792] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.951115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.951899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.955030] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1236a1fa-0205-4a17-909f-c8686b475a69 in Status: IN_PROGRESS for 2s [ 923.959927] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fff10d50-5957-443e-a8f3-dc5ad9677624 in Status: IN_PROGRESS for 2s [ 924.162630] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.162789] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.162859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.163106] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.163199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.163403] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.163508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.163622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.163730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.163983] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.163983] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be updated. [ 924.198830] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.199119] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.199119] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.199400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.199574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.210612] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 925.321897] env[69637]: INFO networking_nsxv3.common.synchronization [req-738272fc-ecfc-4910-b278-6a6f7ed3f899 req-ac8577be-7f59-40b2-ba16-5d77d62ee886 tempest-ServersTestBootFromVolume-426522910 tempest-ServersTestBootFromVolume-426522910-project-member] Enqueued Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGHEST for action security_group_members [ 925.322481] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGHEST for action security_group_members [ 925.322825] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fb52e9e-114d-48d5-9b9e-c3f299243e92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.323017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.323017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.323251] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.323408] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.323619] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.323619] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.323720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.323779] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.323872] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fb52e9e-114d-48d5-9b9e-c3f299243e92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.467897] env[69637]: INFO networking_nsxv3.common.synchronization [req-5785c555-6dca-4595-bfa1-43afbff73a4e req-3fe8d665-55fd-4ccf-a5d8-f761cd0b5782 tempest-VolumesAdminNegativeTest-82035611 tempest-VolumesAdminNegativeTest-82035611-project-member] Enqueued Resource ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e with Priority: HIGHEST for action security_group_members [ 925.468456] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e with Priority: HIGHEST for action security_group_members [ 925.468766] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.468888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.468956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.469323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.469671] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.469671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.469798] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.470795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.470795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.470795] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb74dbe6-1fe7-4183-b9a2-aad8d748259e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.828570] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.828953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.829048] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.829242] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.848368] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.848636] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.848978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.848978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.848978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.849130] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.849219] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 is going to be updated. [ 925.872520] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.872665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.876222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.876461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.876607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.884199] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 in Status: IN_PROGRESS for 2s [ 925.961372] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1236a1fa-0205-4a17-909f-c8686b475a69 in Status: SUCCESS [ 925.961561] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1236a1fa-0205-4a17-909f-c8686b475a69 deletion is rescheduled due to dependency. [ 925.961688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.970425] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fff10d50-5957-443e-a8f3-dc5ad9677624 in Status: SUCCESS [ 925.970425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.972717] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.972717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.972717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.972717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.972933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.972933] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.973163] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.973163] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.973234] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.973306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.973927] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e is going to be updated. [ 926.001296] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.001456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.001509] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.001694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.004019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.009972] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e in Status: IN_PROGRESS for 2s [ 926.220320] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 926.220512] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f deletion is rescheduled due to dependency. [ 926.220626] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.738669] env[69637]: INFO networking_nsxv3.common.synchronization [None req-e9d43779-c022-46e6-825c-3d82f59fc6b1 None None] Enqueued Resource ID: ffaa7df2-381f-43c9-b23d-71795c8cf0e6 with Priority: HIGHEST for action port [ 926.740460] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffaa7df2-381f-43c9-b23d-71795c8cf0e6 with Priority: HIGHEST for action port [ 926.740796] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffaa7df2-381f-43c9-b23d-71795c8cf0e6 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.740908] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffaa7df2-381f-43c9-b23d-71795c8cf0e6" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.740977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffaa7df2-381f-43c9-b23d-71795c8cf0e6" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.741454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffaa7df2-381f-43c9-b23d-71795c8cf0e6" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.741541] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffaa7df2-381f-43c9-b23d-71795c8cf0e6',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.243784] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffaa7df2-381f-43c9-b23d-71795c8cf0e6 [ 927.244036] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.244156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.244238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.244440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.244550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.244647] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffaa7df2-381f-43c9-b23d-71795c8cf0e6 already deleted. [ 927.244732] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffaa7df2-381f-43c9-b23d-71795c8cf0e6" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.386061] env[69637]: INFO networking_nsxv3.common.synchronization [None req-818ad6a1-a2fd-4fe1-a7f8-613ae725294d tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 with Priority: HIGHEST for action security_group_rules [ 927.386293] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 with Priority: HIGHEST for action security_group_rules [ 927.386440] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.386551] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.386614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.386867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.386947] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5de72fa-d001-40b6-8ce0-d5b858d8f9d0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.471646] env[69637]: INFO networking_nsxv3.common.synchronization [None req-01bf222c-156d-4347-bd7d-5162e0dcc6cf tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 with Priority: HIGHEST for action security_group_rules [ 927.474147] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 with Priority: HIGHEST for action security_group_rules [ 927.477603] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.477603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.903705] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 in Status: SUCCESS [ 927.903997] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 deletion is rescheduled due to dependency. [ 927.903997] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.910805] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.911049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.911049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.911678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.911678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.911678] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 already deleted. [ 927.911678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.911920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.911920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.912011] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5de72fa-d001-40b6-8ce0-d5b858d8f9d0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.023482] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e in Status: SUCCESS [ 928.023482] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e deletion is rescheduled due to dependency. [ 928.023482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.440025] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.440025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.440025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.440025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.440025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.440025] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 already deleted. [ 928.440025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.008374] env[69637]: INFO networking_nsxv3.common.synchronization [None req-033e0826-1323-47bd-b506-57b8f277b7d8 None None] Enqueued Resource ID: 3cc7480d-9cee-4452-a771-a9a3fc9bc217 with Priority: HIGHEST for action port [ 929.008660] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc7480d-9cee-4452-a771-a9a3fc9bc217 with Priority: HIGHEST for action port [ 929.009144] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cc7480d-9cee-4452-a771-a9a3fc9bc217 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.009273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cc7480d-9cee-4452-a771-a9a3fc9bc217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.013200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cc7480d-9cee-4452-a771-a9a3fc9bc217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.014452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cc7480d-9cee-4452-a771-a9a3fc9bc217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.014452] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cc7480d-9cee-4452-a771-a9a3fc9bc217',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.517829] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cc7480d-9cee-4452-a771-a9a3fc9bc217 [ 929.518146] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.518297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.518349] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.518556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.518646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.518740] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cc7480d-9cee-4452-a771-a9a3fc9bc217 already deleted. [ 929.518820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cc7480d-9cee-4452-a771-a9a3fc9bc217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.792969] env[69637]: INFO networking_nsxv3.common.synchronization [req-34605f75-655d-4d82-a880-2543d54c7d40 req-3d76dd55-3226-47c0-b429-63a351324abc tempest-ServerPasswordTestJSON-1575499980 tempest-ServerPasswordTestJSON-1575499980-project-member] Enqueued Resource ID: fff10d50-5957-443e-a8f3-dc5ad9677624 with Priority: HIGHEST for action security_group_members [ 929.793991] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff10d50-5957-443e-a8f3-dc5ad9677624 with Priority: HIGHEST for action security_group_members [ 929.793991] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff10d50-5957-443e-a8f3-dc5ad9677624 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.793991] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.794223] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.794223] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.795308] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.795308] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.795308] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.795308] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.795308] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.795308] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fff10d50-5957-443e-a8f3-dc5ad9677624',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.297233] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.297616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.297616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.297699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.297743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.297915] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.298016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.298083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.298403] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.298520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.298642] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fff10d50-5957-443e-a8f3-dc5ad9677624 is going to be updated. [ 930.324696] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.324829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.324899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.325103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.325241] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.332887] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fff10d50-5957-443e-a8f3-dc5ad9677624 in Status: IN_PROGRESS for 2s [ 930.568133] env[69637]: INFO networking_nsxv3.common.synchronization [req-79ab905a-216b-476c-bc29-3005bbc62754 req-927e745d-7361-4feb-8507-4bdc3a950a81 tempest-ServerActionsTestOtherA-1708466346 tempest-ServerActionsTestOtherA-1708466346-project-member] Enqueued Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_members [ 930.568236] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_members [ 930.568525] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.568639] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.568711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.568895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.569102] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.569213] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.569270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.569422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.569497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.569584] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.071409] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.071574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.071726] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.071839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.071900] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.072112] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.072205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.072462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.072462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.072462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.072703] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 is going to be updated. [ 931.104398] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.104398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.104398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.104398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.104398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.111480] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 in Status: IN_PROGRESS for 2s [ 931.450527] env[69637]: INFO networking_nsxv3.common.synchronization [req-d16eab20-a4fb-4753-a0cb-bb73838ea78f req-d0b7be33-3de0-4ddb-a0cc-e4ea1ed9f3dc tempest-ServerRescueNegativeTestJSON-1037752610 tempest-ServerRescueNegativeTestJSON-1037752610-project-member] Enqueued Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_members [ 931.451269] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_members [ 931.451398] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.451518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.451584] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.451825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.451973] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.452190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.452255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.453816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.453816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.453816] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.796306] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-505 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.796508] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-505" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.796635] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-505" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.796996] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-505" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.797361] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.797447] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.797559] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.797789] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.797937] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.798220] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.798356] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.798470] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.798580] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.798690] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.798796] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.798930] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.822038] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.822038] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 931.822038] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.822249] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-505" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.822530] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-9aa1336e-03ec-4fc9-9b00-656138dede14 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.822703] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-9aa1336e-03ec-4fc9-9b00-656138dede14" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.822824] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-9aa1336e-03ec-4fc9-9b00-656138dede14" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.823155] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-9aa1336e-03ec-4fc9-9b00-656138dede14" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.823697] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9aa1336e-03ec-4fc9-9b00-656138dede14',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.955361] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.955361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.955361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.955361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.955361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.955361] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.955361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.955361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.955738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.955738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.955738] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 already deleted. [ 931.955738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.325356] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.325543] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.325671] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.326026] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.326206] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.326386] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 9aa1336e-03ec-4fc9-9b00-656138dede14 not found, creating... [ 932.326650] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.326810] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.326931] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.327195] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.327336] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.327621] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.327791] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.327889] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.328127] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.328291] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.328438] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 9aa1336e-03ec-4fc9-9b00-656138dede14 is going to be created. [ 932.341947] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fff10d50-5957-443e-a8f3-dc5ad9677624 in Status: SUCCESS [ 932.342174] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fff10d50-5957-443e-a8f3-dc5ad9677624 deletion is rescheduled due to dependency. [ 932.342325] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.347896] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.348124] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.348255] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.348852] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.349107] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.349345] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-9aa1336e-03ec-4fc9-9b00-656138dede14" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.059791] env[69637]: INFO networking_nsxv3.common.synchronization [req-d16eab20-a4fb-4753-a0cb-bb73838ea78f req-cfa2c777-6b0f-41d5-90a2-2cbd4cbd2e15 service nova] Enqueued Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_rules [ 933.060108] env[69637]: INFO networking_nsxv3.common.synchronization [req-d16eab20-a4fb-4753-a0cb-bb73838ea78f req-cfa2c777-6b0f-41d5-90a2-2cbd4cbd2e15 service nova] Enqueued Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_members [ 933.060280] env[69637]: INFO networking_nsxv3.common.synchronization [req-d16eab20-a4fb-4753-a0cb-bb73838ea78f req-cfa2c777-6b0f-41d5-90a2-2cbd4cbd2e15 service nova] Enqueued Resource ID: 9aa1336e-03ec-4fc9-9b00-656138dede14 with Priority: HIGHEST for action port [ 933.060949] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_rules [ 933.065018] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_members [ 933.065018] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aa1336e-03ec-4fc9-9b00-656138dede14 with Priority: HIGHEST for action port [ 933.065018] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.065018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.065018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.065018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.065018] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.066270] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.066427] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.066515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.066766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.066982] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.067425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.067425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.067425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.067601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.067652] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.068696] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-9aa1336e-03ec-4fc9-9b00-656138dede14 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.068837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9aa1336e-03ec-4fc9-9b00-656138dede14" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.068931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9aa1336e-03ec-4fc9-9b00-656138dede14" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.069150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9aa1336e-03ec-4fc9-9b00-656138dede14" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.069726] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9aa1336e-03ec-4fc9-9b00-656138dede14',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.121387] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 in Status: SUCCESS [ 933.121573] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 deletion is rescheduled due to dependency. [ 933.121685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.572070] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.572642] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.572832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.573294] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9aa1336e-03ec-4fc9-9b00-656138dede14 with status ACTIVE [ 933.573294] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.573294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.573294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.573566] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.573705] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.574209] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.574360] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.574447] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.574631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.574737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.574946] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.575084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.575169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.575434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.575434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.575614] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9aa1336e-03ec-4fc9-9b00-656138dede14 is going to be updated. [ 933.596356] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.596610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.596702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.596898] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.597348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.597348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9aa1336e-03ec-4fc9-9b00-656138dede14" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.078295] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.580513] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.580675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.580719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.580954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.581058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.581770] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 is going to be created. [ 934.604399] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.604548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.604607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.604813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.604970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.614228] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: UNINITIALIZED for 2s [ 936.625719] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: SUCCESS [ 936.626031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.626176] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.626557] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.626701] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.626701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.626811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.626935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.626975] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.627072] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.627163] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.061497] env[69637]: INFO networking_nsxv3.common.synchronization [req-ef337d9e-a03e-4819-a939-0c5f8392b384 req-36e76dd0-696a-49e9-9667-67646e5e04de tempest-ServerRescueNegativeTestJSON-1037752610 tempest-ServerRescueNegativeTestJSON-1037752610-project-member] Enqueued Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_members [ 937.062042] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_members [ 937.062347] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.062472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.062543] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.062737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.062882] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.062980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.063062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.063195] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.063279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.063369] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.131522] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.131522] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.375644] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-505 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.375644] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-505" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.375644] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-505" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.375644] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-505" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.375644] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.375644] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.376918] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.376918] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.376918] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.376918] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 937.376918] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.376918] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.377194] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.377194] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 937.377346] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.378911] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.399203] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.399384] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 937.399524] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.399696] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-505" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.400008] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-35be4fd8-a43a-4af4-86ba-1efb05fdb65f taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.400190] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-35be4fd8-a43a-4af4-86ba-1efb05fdb65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.400313] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-35be4fd8-a43a-4af4-86ba-1efb05fdb65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.400629] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-35be4fd8-a43a-4af4-86ba-1efb05fdb65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.400778] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35be4fd8-a43a-4af4-86ba-1efb05fdb65f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.565788] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.903704] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.904010] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.904146] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.904433] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.904586] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.904776] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 35be4fd8-a43a-4af4-86ba-1efb05fdb65f not found, creating... [ 937.905010] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.905241] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.905387] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.905521] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.905660] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.905949] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.906199] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.906327] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.906535] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.906681] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.906814] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 35be4fd8-a43a-4af4-86ba-1efb05fdb65f is going to be created. [ 937.940182] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.940182] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.940182] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.940182] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.940182] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.940182] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-35be4fd8-a43a-4af4-86ba-1efb05fdb65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.067941] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.569922] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.570182] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.570182] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.570377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.570469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.570567] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 is going to be updated. [ 938.597733] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.597850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.597938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.598162] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.598300] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.609163] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: IN_PROGRESS for 2s [ 938.628405] env[69637]: INFO networking_nsxv3.common.synchronization [req-ef337d9e-a03e-4819-a939-0c5f8392b384 req-58297bc5-1217-4fef-ae3c-1358457cdc3a service nova] Enqueued Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_rules [ 938.628677] env[69637]: INFO networking_nsxv3.common.synchronization [req-ef337d9e-a03e-4819-a939-0c5f8392b384 req-58297bc5-1217-4fef-ae3c-1358457cdc3a service nova] Enqueued Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_members [ 938.628842] env[69637]: INFO networking_nsxv3.common.synchronization [req-ef337d9e-a03e-4819-a939-0c5f8392b384 req-58297bc5-1217-4fef-ae3c-1358457cdc3a service nova] Enqueued Resource ID: 35be4fd8-a43a-4af4-86ba-1efb05fdb65f with Priority: HIGHEST for action port [ 938.629401] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_rules [ 938.629531] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_members [ 938.629628] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35be4fd8-a43a-4af4-86ba-1efb05fdb65f with Priority: HIGHEST for action port [ 938.629893] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.629993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.630200] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.630281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.630448] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-35be4fd8-a43a-4af4-86ba-1efb05fdb65f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.630548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35be4fd8-a43a-4af4-86ba-1efb05fdb65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.632827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35be4fd8-a43a-4af4-86ba-1efb05fdb65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.632827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35be4fd8-a43a-4af4-86ba-1efb05fdb65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.632827] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35be4fd8-a43a-4af4-86ba-1efb05fdb65f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.133126] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35be4fd8-a43a-4af4-86ba-1efb05fdb65f with status ACTIVE [ 939.133441] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.133535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.133535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.133756] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.133879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.134033] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.134196] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.134196] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.135016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.135016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.135016] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.135016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.135016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.135016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.135016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.135016] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35be4fd8-a43a-4af4-86ba-1efb05fdb65f is going to be updated. [ 939.159437] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.159620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.159720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.159961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.160148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.160348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35be4fd8-a43a-4af4-86ba-1efb05fdb65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.617147] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: SUCCESS [ 940.618097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.618355] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.618606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.619470] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.619470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.619470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.619470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.619470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.619470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.619879] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.619879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.619879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.619879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.620042] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.620042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.620331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.620484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.620565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.620670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.620762] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.621866] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.621866] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.625021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.625021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.625021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.625021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.625021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.625021] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.660603] env[69637]: INFO networking_nsxv3.common.synchronization [req-aeae3d24-8332-4e6a-8bf8-c472f0dd30ec req-738e521e-5cfa-4857-9e39-fd3442b73f72 tempest-ServerActionsV293TestJSON-116364786 tempest-ServerActionsV293TestJSON-116364786-project-member] Enqueued Resource ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 with Priority: HIGHEST for action security_group_members [ 940.661129] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 with Priority: HIGHEST for action security_group_members [ 940.661465] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb173e06-7b41-4fdf-ae0b-3bb378905a07 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.661599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.661669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.661870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.663331] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.663331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.663495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.663814] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.663985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.664289] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb173e06-7b41-4fdf-ae0b-3bb378905a07',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.067029] env[69637]: INFO networking_nsxv3.common.synchronization [req-272645ca-f60f-4043-8cdc-ca12e2499904 req-06c51658-c579-42b9-8a6c-d07273cb78a3 tempest-ServersWithSpecificFlavorTestJSON-315105085 tempest-ServersWithSpecificFlavorTestJSON-315105085-project-member] Enqueued Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_members [ 941.067550] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_members [ 941.067854] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-108f5aaf-b223-4e3b-b27d-aa7c7e251598 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.067979] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.068082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.068319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.068474] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.068572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.068633] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.068775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.068856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.068949] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.125061] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c35ee80-fc38-4bea-b273-773d4bf4b918: rpc.has_security_group_logging(os_id): False [ 941.126612] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.145180] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.145346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.145387] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.145587] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.145671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.145848] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.145965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.146402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.146402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.146402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.146640] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.146640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.146640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.146753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.148329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.148329] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.148329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.148329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.148329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.148329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.148329] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 is going to be created. [ 941.167443] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.168594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.168594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.168594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.194309] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.194554] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.194667] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.194743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.194935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.195021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.195106] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 is going to be updated. [ 941.211688] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.211834] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.211883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.212115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.212294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.219319] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.219436] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.219506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.219685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.219813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.223683] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: IN_PROGRESS for 2s [ 941.227688] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 in Status: IN_PROGRESS for 2s [ 941.573660] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.573819] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.573892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.574185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.574282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.574483] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.574584] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.574646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.574963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.574963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.574963] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 already deleted. [ 941.575124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.633121] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.876026] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-480 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.876250] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.876380] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.876709] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.879388] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.880137] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.880278] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.880530] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.880680] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.880893] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.881020] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.881135] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.881250] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.881361] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.881661] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.881811] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.900341] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.900520] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 941.900664] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.901170] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.901352] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.901537] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.901672] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.902015] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.902170] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.135933] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.136904] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.136904] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.137138] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.137373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.137527] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 is going to be updated. [ 942.167590] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.167590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.167590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.167827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.167981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.180094] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: IN_PROGRESS for 2s [ 942.407020] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.407020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.407020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.407020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.407020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.407020] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2 not found, creating... [ 942.407020] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.407020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.407020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.407020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.407020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.407624] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.407624] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.407624] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.407624] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.407624] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.407805] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2 is going to be created. [ 942.427173] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.427409] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.427540] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.427818] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.428072] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.428310] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.131515] env[69637]: INFO networking_nsxv3.common.synchronization [req-5d823e8e-c49f-46f1-9bb5-371be3f35f3e req-1261e1b0-ef95-4349-bc52-2d22f6bf5e64 tempest-ServersAdminTestJSON-567435686 tempest-ServersAdminTestJSON-567435686-project-member] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 943.133186] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 943.133186] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.133186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.133186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.135125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.135125] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.135125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.135125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.135125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.135125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.135125] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.237282] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 in Status: SUCCESS [ 943.237518] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb173e06-7b41-4fdf-ae0b-3bb378905a07 deletion is rescheduled due to dependency. [ 943.237662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb173e06-7b41-4fdf-ae0b-3bb378905a07" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.238745] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: SUCCESS [ 943.238923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.239089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.239298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.239393] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.356646] env[69637]: INFO networking_nsxv3.common.synchronization [req-73adb45d-7500-434d-97e0-8a441eb21b73 req-f1bf7298-dabe-4ec8-a7b5-d37adc885aed tempest-ServersTestFqdnHostnames-1313009998 tempest-ServersTestFqdnHostnames-1313009998-project-member] Enqueued Resource ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 with Priority: HIGHEST for action security_group_members [ 943.357191] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 with Priority: HIGHEST for action security_group_members [ 943.357529] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-23bbf0c1-9856-41c8-b206-759ddb9f7695 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.357654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.357722] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.357970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.359728] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.359820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.359854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.360031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.360336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.360336] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23bbf0c1-9856-41c8-b206-759ddb9f7695',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.514114] env[69637]: INFO networking_nsxv3.common.synchronization [req-272645ca-f60f-4043-8cdc-ca12e2499904 req-292b2b9b-b2f4-4c34-8cf8-31d9ef5914a1 service nova] Enqueued Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_rules [ 943.514114] env[69637]: INFO networking_nsxv3.common.synchronization [req-272645ca-f60f-4043-8cdc-ca12e2499904 req-292b2b9b-b2f4-4c34-8cf8-31d9ef5914a1 service nova] Enqueued Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_members [ 943.514114] env[69637]: INFO networking_nsxv3.common.synchronization [req-272645ca-f60f-4043-8cdc-ca12e2499904 req-292b2b9b-b2f4-4c34-8cf8-31d9ef5914a1 service nova] Enqueued Resource ID: e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2 with Priority: HIGHEST for action port [ 943.514114] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_rules [ 943.514114] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_members [ 943.514515] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2 with Priority: HIGHEST for action port [ 943.514894] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.514894] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.515065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.515847] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.515847] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.516495] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-108f5aaf-b223-4e3b-b27d-aa7c7e251598 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.516742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.516742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.517052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.517052] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.517052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.517724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.517724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.517724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.517724] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.518230] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.518230] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.518863] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.518863] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.518863] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.641021] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.738709] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-296 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.738860] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-296" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.739069] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-296" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.739507] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-296" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.739638] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.739883] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.740155] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.740429] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.740651] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.741085] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.741085] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.741947] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.742078] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.742258] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.742478] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.742637] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.746132] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.746335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.764306] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.764477] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 943.764619] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.764803] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-296" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.765133] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-0950c6bb-fbe0-4682-94ab-92df21769f09 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.765385] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-0950c6bb-fbe0-4682-94ab-92df21769f09" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.765534] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-0950c6bb-fbe0-4682-94ab-92df21769f09" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.765845] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-0950c6bb-fbe0-4682-94ab-92df21769f09" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.765990] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0950c6bb-fbe0-4682-94ab-92df21769f09',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.861965] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.862139] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.862236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.862414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.862510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.862691] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.862801] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.862873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.862977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.863075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.863149] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 already deleted. [ 943.863264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.021438] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-108f5aaf-b223-4e3b-b27d-aa7c7e251598 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.021587] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.021723] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2 with status ACTIVE [ 944.021892] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.021998] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.022317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.022317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.022482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.022567] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.022642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.022694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.023824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.023824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.023824] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.023824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.023824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.023824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.023824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.023824] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2 is going to be updated. [ 944.024809] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.047174] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.047174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.047174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.047174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.047174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.047174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3d06a6a-5c2b-46d6-95e4-c1fc2b38b3a2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.144972] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.198281] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: SUCCESS [ 944.198281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.198281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.198281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.198281] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.198281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.198281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.198281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.198281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.198281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.198281] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.272039] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.272039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.272039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.272039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.272039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.272039] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 0950c6bb-fbe0-4682-94ab-92df21769f09 not found, creating... [ 944.272039] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.272039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.272039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.272039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.272039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.272509] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.272509] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.272509] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.272509] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.272509] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.272509] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 0950c6bb-fbe0-4682-94ab-92df21769f09 is going to be created. [ 944.294624] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.295090] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.295403] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.295810] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.296221] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.296614] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-0950c6bb-fbe0-4682-94ab-92df21769f09" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.528337] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.647674] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.647829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.647900] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.648216] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.648216] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.648318] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 is going to be updated. [ 944.680379] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.680379] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.680379] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.680379] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.680379] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.688815] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: IN_PROGRESS for 2s [ 944.700465] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.700612] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.700691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.700899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.701079] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.701183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.701240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.701396] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.701535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.701580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.701695] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.701875] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.701875] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.702048] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.702108] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.702195] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.702542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.702542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.702542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.702542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.702700] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.032392] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.032550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.032618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.032825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.032914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.033016] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 is going to be created. [ 945.060944] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.061139] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.061199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.061363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.061523] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.077343] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 in Status: UNINITIALIZED for 2s [ 945.205383] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c35ee80-fc38-4bea-b273-773d4bf4b918: rpc.has_security_group_logging(os_id): False [ 945.230305] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.230458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.230541] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.230739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.230830] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.231026] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.231129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.231190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.231341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.231420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.231613] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.231708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.231765] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.231906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.231979] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.232176] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.232270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.232330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.232501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.232596] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.232673] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 is going to be updated. [ 945.311780] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.311938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.311998] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.312223] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.312367] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.322912] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: IN_PROGRESS for 2s [ 945.379046] env[69637]: INFO networking_nsxv3.common.synchronization [req-73adb45d-7500-434d-97e0-8a441eb21b73 req-0b6dbfb9-0c49-4cad-9041-964eb2b4208a service nova] Enqueued Resource ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 with Priority: HIGHEST for action security_group_rules [ 945.379256] env[69637]: INFO networking_nsxv3.common.synchronization [req-73adb45d-7500-434d-97e0-8a441eb21b73 req-0b6dbfb9-0c49-4cad-9041-964eb2b4208a service nova] Enqueued Resource ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 with Priority: HIGHEST for action security_group_members [ 945.379352] env[69637]: INFO networking_nsxv3.common.synchronization [req-73adb45d-7500-434d-97e0-8a441eb21b73 req-0b6dbfb9-0c49-4cad-9041-964eb2b4208a service nova] Enqueued Resource ID: 0950c6bb-fbe0-4682-94ab-92df21769f09 with Priority: HIGHEST for action port [ 945.384749] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 with Priority: HIGHEST for action security_group_rules [ 945.384921] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 with Priority: HIGHEST for action security_group_members [ 945.388020] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0950c6bb-fbe0-4682-94ab-92df21769f09 with Priority: HIGHEST for action port [ 945.388020] env[69637]: INFO networking_nsxv3.common.synchronization [req-c94c33d0-d673-4f50-abb1-b5259c491894 req-3b43b446-8367-4b57-ae0f-f17cbff15760 tempest-MigrationsAdminTest-855510084 tempest-MigrationsAdminTest-855510084-project-member] Enqueued Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_members [ 945.388020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23bbf0c1-9856-41c8-b206-759ddb9f7695 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.388020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.388020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.388020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.388020] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23bbf0c1-9856-41c8-b206-759ddb9f7695',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.388632] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-23bbf0c1-9856-41c8-b206-759ddb9f7695 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.388753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.388812] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.388972] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.389126] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.389217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.389285] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.389414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.389493] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.389581] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23bbf0c1-9856-41c8-b206-759ddb9f7695',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.390300] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-0950c6bb-fbe0-4682-94ab-92df21769f09 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.392954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0950c6bb-fbe0-4682-94ab-92df21769f09" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.392954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0950c6bb-fbe0-4682-94ab-92df21769f09" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.392954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0950c6bb-fbe0-4682-94ab-92df21769f09" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.392954] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0950c6bb-fbe0-4682-94ab-92df21769f09',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.395927] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_members [ 945.397607] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.397607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.397607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.397607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.397607] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.397607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.397607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.397607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.397607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.397607] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.896872] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0950c6bb-fbe0-4682-94ab-92df21769f09 with status ACTIVE [ 945.897254] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.897569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.897751] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.898110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.898280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.898576] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.898826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.898894] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.899258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.899356] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.899588] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.899669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.899748] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.899901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.899981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.900466] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0950c6bb-fbe0-4682-94ab-92df21769f09 is going to be updated. [ 945.902304] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-23bbf0c1-9856-41c8-b206-759ddb9f7695 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.902456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.902652] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23bbf0c1-9856-41c8-b206-759ddb9f7695',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.903752] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.941118] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.941280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.941410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.941578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.941721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.941884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0950c6bb-fbe0-4682-94ab-92df21769f09" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.111914] env[69637]: INFO networking_nsxv3.common.synchronization [None req-f759f8d4-4487-4214-8b59-3c4571d98f40 tempest-ServerDiskConfigTestJSON-538739594 tempest-ServerDiskConfigTestJSON-538739594-project-member] Enqueued Resource ID: bf521308-ffaa-4e60-a306-6c144aee23d0 with Priority: HIGHEST for action security_group_rules [ 946.112457] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf521308-ffaa-4e60-a306-6c144aee23d0 with Priority: HIGHEST for action security_group_rules [ 946.112831] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf521308-ffaa-4e60-a306-6c144aee23d0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.112931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf521308-ffaa-4e60-a306-6c144aee23d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.112931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf521308-ffaa-4e60-a306-6c144aee23d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.115827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf521308-ffaa-4e60-a306-6c144aee23d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.115827] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf521308-ffaa-4e60-a306-6c144aee23d0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.196112] env[69637]: INFO networking_nsxv3.common.synchronization [None req-e1d01ab6-d286-4606-a458-0eb4c8f3180a tempest-ServerDiskConfigTestJSON-538739594 tempest-ServerDiskConfigTestJSON-538739594-project-member] Enqueued Resource ID: bf521308-ffaa-4e60-a306-6c144aee23d0 with Priority: HIGHEST for action security_group_rules [ 946.197082] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf521308-ffaa-4e60-a306-6c144aee23d0 with Priority: HIGHEST for action security_group_rules [ 946.197082] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf521308-ffaa-4e60-a306-6c144aee23d0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.197082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf521308-ffaa-4e60-a306-6c144aee23d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.332306] env[69637]: INFO networking_nsxv3.common.synchronization [None req-7e377ffa-b1a8-4d82-8e20-35878622af96 None None] Enqueued Resource ID: 801ba489-b0ac-4dd1-8d66-b60e7a6bcdc4 with Priority: HIGHEST for action port [ 946.332846] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 801ba489-b0ac-4dd1-8d66-b60e7a6bcdc4 with Priority: HIGHEST for action port [ 946.333189] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-801ba489-b0ac-4dd1-8d66-b60e7a6bcdc4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.333340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-801ba489-b0ac-4dd1-8d66-b60e7a6bcdc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.333563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-801ba489-b0ac-4dd1-8d66-b60e7a6bcdc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.334883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-801ba489-b0ac-4dd1-8d66-b60e7a6bcdc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.334883] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('801ba489-b0ac-4dd1-8d66-b60e7a6bcdc4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.407676] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23bbf0c1-9856-41c8-b206-759ddb9f7695',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.408656] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.577680] env[69637]: INFO networking_nsxv3.common.synchronization [None req-a433479b-2493-4e53-b091-b880f4326c67 None None] Enqueued Resource ID: 1b8cd67e-b058-4242-9d3e-faddaee8cbeb with Priority: HIGHEST for action port [ 946.579323] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b8cd67e-b058-4242-9d3e-faddaee8cbeb with Priority: HIGHEST for action port [ 946.579323] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b8cd67e-b058-4242-9d3e-faddaee8cbeb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.579323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b8cd67e-b058-4242-9d3e-faddaee8cbeb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.579323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b8cd67e-b058-4242-9d3e-faddaee8cbeb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.579718] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b8cd67e-b058-4242-9d3e-faddaee8cbeb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.579815] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b8cd67e-b058-4242-9d3e-faddaee8cbeb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.640308] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.642537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.642537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.642537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.642537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.642537] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf521308-ffaa-4e60-a306-6c144aee23d0 already deleted. [ 946.642537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf521308-ffaa-4e60-a306-6c144aee23d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.642537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf521308-ffaa-4e60-a306-6c144aee23d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.642537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf521308-ffaa-4e60-a306-6c144aee23d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.642537] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf521308-ffaa-4e60-a306-6c144aee23d0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.700243] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: SUCCESS [ 946.700788] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.838925] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 801ba489-b0ac-4dd1-8d66-b60e7a6bcdc4 [ 946.838925] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.838925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.838925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.839150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.839654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.839654] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:801ba489-b0ac-4dd1-8d66-b60e7a6bcdc4 already deleted. [ 946.839654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-801ba489-b0ac-4dd1-8d66-b60e7a6bcdc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.909259] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.909412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.909484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.909690] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.909776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.909874] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 is going to be created. [ 946.911238] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.911353] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.911449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.911579] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.911661] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.911747] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 is going to be updated. [ 946.942179] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.942363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.942419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.942598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.942762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.948799] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.950019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.950019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.950019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.950019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.952775] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 in Status: UNINITIALIZED for 2s [ 946.955174] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: IN_PROGRESS for 2s [ 947.081854] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b8cd67e-b058-4242-9d3e-faddaee8cbeb [ 947.081979] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.082047] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.082086] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.082271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.082348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.082436] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b8cd67e-b058-4242-9d3e-faddaee8cbeb already deleted. [ 947.082511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b8cd67e-b058-4242-9d3e-faddaee8cbeb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.088135] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 in Status: SUCCESS [ 947.088346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.088498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.088691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.088869] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.088982] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.089072] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.089226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.089306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.089391] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.089480] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.166801] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.166974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.167023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.167917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.169890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.169890] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf521308-ffaa-4e60-a306-6c144aee23d0 already deleted. [ 947.169890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf521308-ffaa-4e60-a306-6c144aee23d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.334816] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: SUCCESS [ 947.334816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.594514] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.097093] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 108f5aaf-b223-4e3b-b27d-aa7c7e251598: rpc.has_security_group_logging(os_id): False [ 948.114455] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.114591] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.114664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.114873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.114950] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.115207] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.115310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.115371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.115601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.115672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.115755] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 is going to be created. [ 948.170811] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.170978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.171046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.171263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.171484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.184307] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 in Status: IN_PROGRESS for 2s [ 948.527559] env[69637]: INFO networking_nsxv3.common.synchronization [None req-1378f7e9-c263-49dc-b863-81947c77b70b None None] Enqueued Resource ID: dc92ec2b-7c4a-459a-9569-ab9e4790395f with Priority: HIGHEST for action port [ 948.527803] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc92ec2b-7c4a-459a-9569-ab9e4790395f with Priority: HIGHEST for action port [ 948.528390] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc92ec2b-7c4a-459a-9569-ab9e4790395f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.528533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc92ec2b-7c4a-459a-9569-ab9e4790395f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.528593] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc92ec2b-7c4a-459a-9569-ab9e4790395f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.529104] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc92ec2b-7c4a-459a-9569-ab9e4790395f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.529189] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc92ec2b-7c4a-459a-9569-ab9e4790395f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.709429] env[69637]: INFO networking_nsxv3.common.synchronization [None req-eff1e883-5c1f-479e-b7e2-3b6933ebb7c0 tempest-ServerActionsTestJSON-2076172663 tempest-ServerActionsTestJSON-2076172663-project-member] Enqueued Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_rules [ 948.712452] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_rules [ 948.714552] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.714727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.714827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.715231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.715291] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.853047] env[69637]: INFO networking_nsxv3.common.synchronization [None req-63c8d232-27e7-4b08-970c-d570fc095e06 tempest-ServerActionsTestJSON-2076172663 tempest-ServerActionsTestJSON-2076172663-project-member] Enqueued Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_rules [ 948.853593] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_rules [ 948.853901] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.854036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.892094] env[69637]: INFO networking_nsxv3.common.synchronization [None req-492cc914-9206-48c2-b2ba-cf11bcec17b3 None None] Enqueued Resource ID: 5bf4013d-d95d-4017-9cf8-957513af698b with Priority: HIGHEST for action port [ 948.892367] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf4013d-d95d-4017-9cf8-957513af698b with Priority: HIGHEST for action port [ 948.892941] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bf4013d-d95d-4017-9cf8-957513af698b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.893077] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bf4013d-d95d-4017-9cf8-957513af698b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.893142] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bf4013d-d95d-4017-9cf8-957513af698b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.893377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bf4013d-d95d-4017-9cf8-957513af698b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.893465] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bf4013d-d95d-4017-9cf8-957513af698b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.962864] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 in Status: SUCCESS [ 948.963143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.963870] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: SUCCESS [ 948.964062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.964590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.964750] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.964937] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.971311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.971311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.971311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.971311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.971311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.971311] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23bbf0c1-9856-41c8-b206-759ddb9f7695',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.032126] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc92ec2b-7c4a-459a-9569-ab9e4790395f [ 949.032357] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.032598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.032598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.032778] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.032875] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.032968] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc92ec2b-7c4a-459a-9569-ab9e4790395f already deleted. [ 949.033075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc92ec2b-7c4a-459a-9569-ab9e4790395f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.242472] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.242625] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.242697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.242937] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.243152] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.243152] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 already deleted. [ 949.243221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.243750] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.243947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.244025] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.396166] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5bf4013d-d95d-4017-9cf8-957513af698b [ 949.396451] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.396582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.396707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.396862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.396950] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.397056] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5bf4013d-d95d-4017-9cf8-957513af698b already deleted. [ 949.397138] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bf4013d-d95d-4017-9cf8-957513af698b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.471447] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23bbf0c1-9856-41c8-b206-759ddb9f7695',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.542066] env[69637]: INFO networking_nsxv3.common.synchronization [req-ae7e59cf-c302-439e-bf86-fc297b71cd0d req-c35a74b9-1a5e-48f1-ab8f-199f200e45ce tempest-ServerDiskConfigTestJSON-538739594 tempest-ServerDiskConfigTestJSON-538739594-project-member] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 949.542343] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 949.542481] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.542600] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.542664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.542852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.543016] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.545024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.545024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.545024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.545024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.545024] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.765176] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.765336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.765410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.765610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.765715] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.765841] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 already deleted. [ 949.765894] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.973288] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23bbf0c1-9856-41c8-b206-759ddb9f7695: rpc.has_security_group_logging(os_id): False [ 949.993403] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.993552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.993617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.993820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.993909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.994167] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.994272] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.994323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.994475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.994552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.994637] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 is going to be created. [ 950.047571] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.047817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.047817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.048017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.048115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.048312] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.048409] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.048472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.048621] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.048702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.048787] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 950.100171] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.100353] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.100430] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.100642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.100786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.106304] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.106304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.106558] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.106558] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.106748] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.110940] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 950.121427] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 in Status: IN_PROGRESS for 2s [ 950.207760] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 in Status: SUCCESS [ 950.208011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.152429] env[69637]: INFO networking_nsxv3.common.synchronization [req-836e8f69-489e-41f8-be91-fa038b41a33b req-d6e4b33f-51b5-4d28-a149-e4ede94388e6 tempest-ServerRescueTestJSON-1328189417 tempest-ServerRescueTestJSON-1328189417-project-member] Enqueued Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_members [ 951.152721] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_members [ 951.152997] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.153288] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.153288] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.153720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.153889] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.153997] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.154085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.154247] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.154334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.154429] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.441903] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-538 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.442159] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-538" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.442296] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-538" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.442568] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-538" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.442845] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.443013] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.443139] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.443389] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.443544] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.443777] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.443911] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.444034] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.444169] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.444312] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.444518] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.444621] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.464328] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.464549] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 951.464743] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.464970] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-538" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.465384] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-df5301ab-da15-4019-9c61-40ca06c4c5de taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.465678] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-df5301ab-da15-4019-9c61-40ca06c4c5de" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.465787] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-df5301ab-da15-4019-9c61-40ca06c4c5de" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.466200] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-df5301ab-da15-4019-9c61-40ca06c4c5de" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.466442] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df5301ab-da15-4019-9c61-40ca06c4c5de',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.657554] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.972247] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.972493] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.972625] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.972897] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.973119] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.973288] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port df5301ab-da15-4019-9c61-40ca06c4c5de not found, creating... [ 951.973547] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.973749] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.973819] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.974065] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.974210] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.974634] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.974857] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.974986] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.975235] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.975379] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.975539] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: df5301ab-da15-4019-9c61-40ca06c4c5de is going to be created. [ 952.001954] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.002488] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.002488] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.002641] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.002875] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.003896] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-df5301ab-da15-4019-9c61-40ca06c4c5de" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.122546] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 952.122546] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac deletion is rescheduled due to dependency. [ 952.122546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.139075] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 in Status: SUCCESS [ 952.139075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.161230] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.666623] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.666995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.667264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.667718] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.667842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.667948] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe is going to be updated. [ 952.670799] env[69637]: INFO networking_nsxv3.common.synchronization [req-836e8f69-489e-41f8-be91-fa038b41a33b req-d970f18d-0bfb-4b2d-b6bc-7ca24741104c service nova] Enqueued Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_rules [ 952.670996] env[69637]: INFO networking_nsxv3.common.synchronization [req-836e8f69-489e-41f8-be91-fa038b41a33b req-d970f18d-0bfb-4b2d-b6bc-7ca24741104c service nova] Enqueued Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_members [ 952.671362] env[69637]: INFO networking_nsxv3.common.synchronization [req-836e8f69-489e-41f8-be91-fa038b41a33b req-d970f18d-0bfb-4b2d-b6bc-7ca24741104c service nova] Enqueued Resource ID: df5301ab-da15-4019-9c61-40ca06c4c5de with Priority: HIGHEST for action port [ 952.672142] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_rules [ 952.672491] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_members [ 952.672777] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df5301ab-da15-4019-9c61-40ca06c4c5de with Priority: HIGHEST for action port [ 952.674020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f38a6b0-1f81-42d8-9f18-8deb24c569fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.674344] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.674511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.674762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.674987] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.676101] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.679187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.679187] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-df5301ab-da15-4019-9c61-40ca06c4c5de taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.679187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df5301ab-da15-4019-9c61-40ca06c4c5de" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.679187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df5301ab-da15-4019-9c61-40ca06c4c5de" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.679187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df5301ab-da15-4019-9c61-40ca06c4c5de" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.679187] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df5301ab-da15-4019-9c61-40ca06c4c5de',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.710022] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.710022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.710022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.710256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.710294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.720343] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe in Status: IN_PROGRESS for 2s [ 953.178939] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.178939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.183040] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df5301ab-da15-4019-9c61-40ca06c4c5de with status ACTIVE [ 953.183040] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.183040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.183040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.183040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.183040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.183040] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.183534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.183534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.183534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.183534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.183534] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.183703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.183735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.183916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.183980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.184043] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df5301ab-da15-4019-9c61-40ca06c4c5de is going to be updated. [ 953.231590] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.231817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.231817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.232046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.232188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.232355] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df5301ab-da15-4019-9c61-40ca06c4c5de" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.425413] env[69637]: INFO networking_nsxv3.common.synchronization [req-08755df3-3707-4036-9e5e-08cf4094733f req-591a0cb3-fc13-4c91-a327-367197a1c6d1 tempest-ImagesTestJSON-1924392618 tempest-ImagesTestJSON-1924392618-project-member] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 953.426016] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 953.427051] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.427051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.427051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.427051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.427327] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.427327] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.427327] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.427499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.427499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.427897] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.930449] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.930608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.930724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.930924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.930976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.931202] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.931302] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.931364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.931512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.931591] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.931675] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 953.958284] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.958441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.958488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.959115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.959893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.968546] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 954.499667] env[69637]: INFO networking_nsxv3.common.synchronization [None req-ae363b18-52a6-4f07-bf51-e48070438c83 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_rules [ 954.499979] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_rules [ 954.501060] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e078c82-40fd-4661-9911-198585d187a7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.501060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.501060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.501060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.501060] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.595790] env[69637]: INFO networking_nsxv3.common.synchronization [None req-ac2ca393-714e-49c0-8ca8-4b9dbf5d821e tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_rules [ 954.596606] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_rules [ 954.597119] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e078c82-40fd-4661-9911-198585d187a7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.597119] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.729798] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe in Status: SUCCESS [ 954.730040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.730767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.731588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.731588] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.731588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.731588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.731588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.731588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.731896] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.021299] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.021452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.021522] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.021741] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.021830] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.021931] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e078c82-40fd-4661-9911-198585d187a7 already deleted. [ 955.022032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.022176] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.022323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.022410] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.236426] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.542137] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.542531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.542531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.542640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.542688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.542783] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e078c82-40fd-4661-9911-198585d187a7 already deleted. [ 955.542868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.738765] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.977770] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 955.977981] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 deletion is rescheduled due to dependency. [ 955.978137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.241260] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.241423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.241647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.241717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.241805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.241903] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe is going to be updated. [ 956.277532] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.277705] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.277785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.278008] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.278162] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.286434] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe in Status: IN_PROGRESS for 2s [ 958.297582] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe in Status: SUCCESS [ 958.298077] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.298124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.298311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.298503] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.298614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.298682] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.298824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.298970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.298970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.299081] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.801783] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.802679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.802752] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.803372] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.807124] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.807124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.807124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.807124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.807124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.807124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.807124] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.807124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.807124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.807124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.807760] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.807760] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.807760] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.807872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.808124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.808124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.808239] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.311485] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f38a6b0-1f81-42d8-9f18-8deb24c569fe: rpc.has_security_group_logging(os_id): False [ 959.331135] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.331425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.331568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.331729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.331823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.332061] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.332228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.332315] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.332402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.332483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.332660] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.332936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.332936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.333159] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.333159] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.333243] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.333314] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.333379] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.333517] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.333592] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.333676] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe is going to be updated. [ 959.397028] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.397194] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.397278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.397524] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.397651] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.411251] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe in Status: IN_PROGRESS for 2s [ 959.598033] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 959.598141] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 961.429759] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe in Status: SUCCESS [ 961.430043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.463175] env[69637]: INFO networking_nsxv3.common.synchronization [req-6f418204-fb1a-40b5-8ff1-f217c7699ef4 req-27297bed-6309-4685-b584-04f4a7b0c391 tempest-VolumesAdminNegativeTest-82035611 tempest-VolumesAdminNegativeTest-82035611-project-member] Enqueued Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGHEST for action security_group_members [ 961.463733] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGHEST for action security_group_members [ 961.464057] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ebf57d6-6da5-49a3-83b3-8e08d42464db taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.464179] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.464244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.464439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.464584] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.464683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.464772] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.464904] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.464988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.465509] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ebf57d6-6da5-49a3-83b3-8e08d42464db',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.967944] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.968176] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.968269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.968473] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.994107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.994497] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.994497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.994627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.994741] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.994824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.994912] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db is going to be updated. [ 962.040476] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.041228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.041686] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.042540] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.042540] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.053047] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db in Status: IN_PROGRESS for 2s [ 962.309801] env[69637]: INFO networking_nsxv3.common.synchronization [None req-3a314873-1865-495c-9ab5-fd22e7914453 None None] Enqueued Resource ID: de462db9-309a-4de9-949e-8a4642d9eb9b with Priority: HIGHEST for action port [ 962.311318] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de462db9-309a-4de9-949e-8a4642d9eb9b with Priority: HIGHEST for action port [ 962.311920] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-de462db9-309a-4de9-949e-8a4642d9eb9b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.312051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de462db9-309a-4de9-949e-8a4642d9eb9b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.312117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de462db9-309a-4de9-949e-8a4642d9eb9b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.312364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de462db9-309a-4de9-949e-8a4642d9eb9b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.312453] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de462db9-309a-4de9-949e-8a4642d9eb9b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.814681] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de462db9-309a-4de9-949e-8a4642d9eb9b [ 962.814929] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.815072] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.815145] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.815347] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.815520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.815520] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de462db9-309a-4de9-949e-8a4642d9eb9b already deleted. [ 962.815593] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de462db9-309a-4de9-949e-8a4642d9eb9b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.067684] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db in Status: SUCCESS [ 964.068046] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db deletion is rescheduled due to dependency. [ 964.068155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.124915] env[69637]: INFO networking_nsxv3.common.synchronization [req-592a1995-03b0-4378-a1ad-b1caa796c1b0 req-4a943d9c-ab75-46a2-8ae8-7dcc54852028 tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 with Priority: HIGHEST for action security_group_members [ 964.125511] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 with Priority: HIGHEST for action security_group_members [ 964.125836] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.125960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.127500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.127500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.127500] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.127692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.127813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.128035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.128177] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.128325] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5de72fa-d001-40b6-8ce0-d5b858d8f9d0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.631702] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.631856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.631911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.632156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.632245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.632448] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.632561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.632606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.632746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.632824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.632907] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 already deleted. [ 964.632995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.657406] env[69637]: INFO networking_nsxv3.common.synchronization [None req-ee9e3bdb-ac66-4041-999d-15cafc7c6ef9 None None] Enqueued Resource ID: 8e007323-fcb1-4e2b-bbab-8f1547fb6835 with Priority: HIGHEST for action port [ 964.657656] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e007323-fcb1-4e2b-bbab-8f1547fb6835 with Priority: HIGHEST for action port [ 964.658652] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e007323-fcb1-4e2b-bbab-8f1547fb6835 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.658652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e007323-fcb1-4e2b-bbab-8f1547fb6835" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.658652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e007323-fcb1-4e2b-bbab-8f1547fb6835" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.658652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e007323-fcb1-4e2b-bbab-8f1547fb6835" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.658822] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e007323-fcb1-4e2b-bbab-8f1547fb6835',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.730254] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-19 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.730463] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.731230] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.731230] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.731230] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.731500] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.731500] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.731930] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.731930] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.732072] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 964.735244] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.735545] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.735725] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.735909] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 964.735988] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.736149] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.755679] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.755852] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 964.756010] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.756224] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.756621] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-05e06b91-2aec-4e56-84a1-bf507ce8a08a taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.757047] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-05e06b91-2aec-4e56-84a1-bf507ce8a08a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.757047] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-05e06b91-2aec-4e56-84a1-bf507ce8a08a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.757185] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-05e06b91-2aec-4e56-84a1-bf507ce8a08a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.757327] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05e06b91-2aec-4e56-84a1-bf507ce8a08a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.894015] env[69637]: INFO networking_nsxv3.common.synchronization [None req-7a258d5c-1859-4eb0-a625-b19bb0b29b0a None None] Enqueued Resource ID: 63cf1513-3ddb-4ef6-9706-9c4f24df87ee with Priority: HIGHEST for action port [ 964.894015] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63cf1513-3ddb-4ef6-9706-9c4f24df87ee with Priority: HIGHEST for action port [ 964.894843] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-63cf1513-3ddb-4ef6-9706-9c4f24df87ee taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.894843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63cf1513-3ddb-4ef6-9706-9c4f24df87ee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.894843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63cf1513-3ddb-4ef6-9706-9c4f24df87ee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.894843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63cf1513-3ddb-4ef6-9706-9c4f24df87ee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.894843] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63cf1513-3ddb-4ef6-9706-9c4f24df87ee',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.160585] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e007323-fcb1-4e2b-bbab-8f1547fb6835 [ 965.160851] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.160944] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.161512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.161512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.161512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.161512] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e007323-fcb1-4e2b-bbab-8f1547fb6835 already deleted. [ 965.161512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e007323-fcb1-4e2b-bbab-8f1547fb6835" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.260120] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.260368] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.260496] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.260767] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.260910] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.261081] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 05e06b91-2aec-4e56-84a1-bf507ce8a08a not found, creating... [ 965.261350] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.261501] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.261617] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.262013] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.262013] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.262264] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.263177] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.263177] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.263177] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.263177] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.263177] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 05e06b91-2aec-4e56-84a1-bf507ce8a08a is going to be created. [ 965.286644] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.286644] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.286644] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.286644] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.286644] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.286644] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-05e06b91-2aec-4e56-84a1-bf507ce8a08a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.398970] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63cf1513-3ddb-4ef6-9706-9c4f24df87ee [ 965.398970] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.398970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.398970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.398970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.398970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.398970] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63cf1513-3ddb-4ef6-9706-9c4f24df87ee already deleted. [ 965.398970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63cf1513-3ddb-4ef6-9706-9c4f24df87ee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.018085] env[69637]: INFO networking_nsxv3.common.synchronization [req-592a1995-03b0-4378-a1ad-b1caa796c1b0 req-256e92ef-0894-4c3c-b9e7-64c81f380a40 service nova] Enqueued Resource ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 with Priority: HIGHEST for action security_group_rules [ 966.018328] env[69637]: INFO networking_nsxv3.common.synchronization [req-592a1995-03b0-4378-a1ad-b1caa796c1b0 req-256e92ef-0894-4c3c-b9e7-64c81f380a40 service nova] Enqueued Resource ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 with Priority: HIGHEST for action security_group_members [ 966.018573] env[69637]: INFO networking_nsxv3.common.synchronization [req-592a1995-03b0-4378-a1ad-b1caa796c1b0 req-256e92ef-0894-4c3c-b9e7-64c81f380a40 service nova] Enqueued Resource ID: 05e06b91-2aec-4e56-84a1-bf507ce8a08a with Priority: HIGHEST for action port [ 966.023523] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 with Priority: HIGHEST for action security_group_rules [ 966.023680] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 with Priority: HIGHEST for action security_group_members [ 966.024989] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05e06b91-2aec-4e56-84a1-bf507ce8a08a with Priority: HIGHEST for action port [ 966.024989] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.024989] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.024989] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.024989] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.024989] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5de72fa-d001-40b6-8ce0-d5b858d8f9d0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.027497] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.027643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.027701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.029197] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.029197] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.029197] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.029197] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.029197] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.029454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.029454] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5de72fa-d001-40b6-8ce0-d5b858d8f9d0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.030670] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-05e06b91-2aec-4e56-84a1-bf507ce8a08a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.030670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05e06b91-2aec-4e56-84a1-bf507ce8a08a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.030868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05e06b91-2aec-4e56-84a1-bf507ce8a08a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.030868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05e06b91-2aec-4e56-84a1-bf507ce8a08a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.031254] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05e06b91-2aec-4e56-84a1-bf507ce8a08a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.397705] env[69637]: INFO networking_nsxv3.common.synchronization [None req-ac46d955-7826-43db-8580-0189275fb3da None None] Enqueued Resource ID: 25ffb206-7337-42c7-a466-40de5a7bbe10 with Priority: HIGHEST for action port [ 966.399988] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ffb206-7337-42c7-a466-40de5a7bbe10 with Priority: HIGHEST for action port [ 966.399988] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-25ffb206-7337-42c7-a466-40de5a7bbe10 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.399988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25ffb206-7337-42c7-a466-40de5a7bbe10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.399988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25ffb206-7337-42c7-a466-40de5a7bbe10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.399988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25ffb206-7337-42c7-a466-40de5a7bbe10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.399988] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25ffb206-7337-42c7-a466-40de5a7bbe10',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.533761] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.536784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.536784] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5de72fa-d001-40b6-8ce0-d5b858d8f9d0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.536784] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05e06b91-2aec-4e56-84a1-bf507ce8a08a with status ACTIVE [ 966.536784] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.536784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.536784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.536784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.536784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.536784] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.536784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.536784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.536784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.536784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.536784] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.536784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.538857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.538857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.538857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.538857] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05e06b91-2aec-4e56-84a1-bf507ce8a08a is going to be updated. [ 966.566502] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.566651] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.566720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.566993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.567148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.567311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05e06b91-2aec-4e56-84a1-bf507ce8a08a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.904539] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25ffb206-7337-42c7-a466-40de5a7bbe10 [ 966.904539] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.904539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.904539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.904539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.904539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.904539] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25ffb206-7337-42c7-a466-40de5a7bbe10 already deleted. [ 966.904539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25ffb206-7337-42c7-a466-40de5a7bbe10" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.040886] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5de72fa-d001-40b6-8ce0-d5b858d8f9d0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.543603] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.543852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.543852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.544552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.544552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.544552] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 is going to be created. [ 967.571816] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.571816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.571816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.571816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.571816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.580125] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 in Status: UNINITIALIZED for 2s [ 969.594042] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 in Status: SUCCESS [ 969.594042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.594042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.594042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.594042] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.594042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.594042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.594042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.594042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.594042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.594042] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5de72fa-d001-40b6-8ce0-d5b858d8f9d0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.096447] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5de72fa-d001-40b6-8ce0-d5b858d8f9d0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.292279] env[69637]: INFO networking_nsxv3.common.synchronization [None req-97712fae-f25c-4a00-9bd6-5c1d17529bc2 tempest-ServerActionsTestOtherA-1708466346 tempest-ServerActionsTestOtherA-1708466346-project-member] Enqueued Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGHEST for action security_group_rules [ 970.294204] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGHEST for action security_group_rules [ 970.294204] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-506fca2b-4bdc-418f-be44-db369f7e1332 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.294204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.294204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.294204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.294204] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('506fca2b-4bdc-418f-be44-db369f7e1332',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.398926] env[69637]: INFO networking_nsxv3.common.synchronization [None req-465ecb9f-351c-46a1-b625-d3b46c406fb8 tempest-ServerActionsTestOtherA-1708466346 tempest-ServerActionsTestOtherA-1708466346-project-member] Enqueued Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGHEST for action security_group_rules [ 970.399537] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGHEST for action security_group_rules [ 970.399858] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-506fca2b-4bdc-418f-be44-db369f7e1332 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.399989] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.503034] env[69637]: INFO networking_nsxv3.common.synchronization [None req-f298876d-4478-461a-beee-81fb9d31335c None None] Enqueued Resource ID: f3ca3a7b-ff88-454f-ac35-1d92660525b3 with Priority: HIGHEST for action port [ 970.503034] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ca3a7b-ff88-454f-ac35-1d92660525b3 with Priority: HIGHEST for action port [ 970.503034] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3ca3a7b-ff88-454f-ac35-1d92660525b3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.503034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3ca3a7b-ff88-454f-ac35-1d92660525b3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.503766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3ca3a7b-ff88-454f-ac35-1d92660525b3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.504120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3ca3a7b-ff88-454f-ac35-1d92660525b3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.504226] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3ca3a7b-ff88-454f-ac35-1d92660525b3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.599032] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5de72fa-d001-40b6-8ce0-d5b858d8f9d0: rpc.has_security_group_logging(os_id): False [ 970.618154] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.618154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.618154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.618154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.618154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.618154] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.618154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.618154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.618154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.618154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.618154] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 is going to be created. [ 970.677460] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.678389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.678389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.678389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.678389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.689664] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 in Status: IN_PROGRESS for 2s [ 970.816754] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.817943] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.818098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.818351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.818475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.818598] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 506fca2b-4bdc-418f-be44-db369f7e1332 already deleted. [ 970.818705] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.818891] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.819286] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.820929] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('506fca2b-4bdc-418f-be44-db369f7e1332',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.006275] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3ca3a7b-ff88-454f-ac35-1d92660525b3 [ 971.006506] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.006632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.006699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.006901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.007051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.007162] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3ca3a7b-ff88-454f-ac35-1d92660525b3 already deleted. [ 971.007247] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3ca3a7b-ff88-454f-ac35-1d92660525b3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.313566] env[69637]: INFO networking_nsxv3.common.synchronization [None req-f3e5f53d-27ad-48c4-ac73-e052bcc39e67 tempest-AttachVolumeTestJSON-2085947096 tempest-AttachVolumeTestJSON-2085947096-project-member] Enqueued Resource ID: cc38a146-8a93-4507-a45a-aaf042f5e30b with Priority: HIGHEST for action security_group_rules [ 971.314325] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc38a146-8a93-4507-a45a-aaf042f5e30b with Priority: HIGHEST for action security_group_rules [ 971.314537] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc38a146-8a93-4507-a45a-aaf042f5e30b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.314664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.314730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.314980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.317953] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc38a146-8a93-4507-a45a-aaf042f5e30b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.346183] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.347021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.347021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.347021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.347021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.347021] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 506fca2b-4bdc-418f-be44-db369f7e1332 already deleted. [ 971.347021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.511527] env[69637]: INFO networking_nsxv3.common.synchronization [None req-49dc9d61-80e4-499d-8dd3-3eb294c70683 tempest-AttachVolumeTestJSON-2085947096 tempest-AttachVolumeTestJSON-2085947096-project-member] Enqueued Resource ID: cc38a146-8a93-4507-a45a-aaf042f5e30b with Priority: HIGHEST for action security_group_rules [ 971.512026] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc38a146-8a93-4507-a45a-aaf042f5e30b with Priority: HIGHEST for action security_group_rules [ 971.512327] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc38a146-8a93-4507-a45a-aaf042f5e30b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.512430] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.837491] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.837768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.837768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.837993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.838094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.838194] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc38a146-8a93-4507-a45a-aaf042f5e30b already deleted. [ 971.838282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.838450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.838593] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.838676] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc38a146-8a93-4507-a45a-aaf042f5e30b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.367157] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.367157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.367157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.367157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.367157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.367157] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc38a146-8a93-4507-a45a-aaf042f5e30b already deleted. [ 972.367157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.668380] env[69637]: INFO networking_nsxv3.common.synchronization [req-5831b5b7-733c-49cd-a1ca-8ac42ff77c0c req-012edef7-2c4d-45db-a30e-950bb1421141 tempest-ServersTestJSON-1659168521 tempest-ServersTestJSON-1659168521-project-member] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 972.668959] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 972.669306] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.669433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.669520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.669721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.669888] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.669988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.670709] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.670890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.670981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.671112] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.701145] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 in Status: SUCCESS [ 972.701370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.082956] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-286 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.083251] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.083300] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.083561] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.083816] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.083974] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.084113] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.084331] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.084499] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.084695] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.084814] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.084932] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.085717] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.086029] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.086183] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.086329] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.107675] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.107887] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 973.107916] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.108161] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.108488] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-60a35938-fe8e-4620-9353-a5b63fd49bb8 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.108664] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-60a35938-fe8e-4620-9353-a5b63fd49bb8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.108783] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-60a35938-fe8e-4620-9353-a5b63fd49bb8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.109109] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-60a35938-fe8e-4620-9353-a5b63fd49bb8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.109256] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60a35938-fe8e-4620-9353-a5b63fd49bb8',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.172557] env[69637]: INFO networking_nsxv3.common.synchronization [None req-82c06718-1d57-45fd-a559-2bfe4b8f7775 None None] Enqueued Resource ID: 635920e2-e4b8-477b-a72e-5ecaa5e866fb with Priority: HIGHEST for action port [ 973.172800] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.173578] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 635920e2-e4b8-477b-a72e-5ecaa5e866fb with Priority: HIGHEST for action port [ 973.174620] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-635920e2-e4b8-477b-a72e-5ecaa5e866fb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.174745] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-635920e2-e4b8-477b-a72e-5ecaa5e866fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.174813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-635920e2-e4b8-477b-a72e-5ecaa5e866fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.175118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-635920e2-e4b8-477b-a72e-5ecaa5e866fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.175199] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('635920e2-e4b8-477b-a72e-5ecaa5e866fb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.186086] env[69637]: INFO networking_nsxv3.common.synchronization [None req-f36af692-8436-4223-9fed-33f2809c016c tempest-ServerRescueNegativeTestJSON-1037752610 tempest-ServerRescueNegativeTestJSON-1037752610-project-member] Enqueued Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGHEST for action security_group_rules [ 973.186789] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGHEST for action security_group_rules [ 973.187153] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26287d78-a077-45b2-9f9c-fbff1368c591 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.187280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.187347] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.187608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.187692] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26287d78-a077-45b2-9f9c-fbff1368c591',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.297825] env[69637]: INFO networking_nsxv3.common.synchronization [None req-b607d328-a71c-4547-8049-faf6f7c084cb tempest-ServerRescueNegativeTestJSON-1037752610 tempest-ServerRescueNegativeTestJSON-1037752610-project-member] Enqueued Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGHEST for action security_group_rules [ 973.302215] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGHEST for action security_group_rules [ 973.302215] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26287d78-a077-45b2-9f9c-fbff1368c591 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.302215] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.611662] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.615017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.615017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.615017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.615017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.615017] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 60a35938-fe8e-4620-9353-a5b63fd49bb8 not found, creating... [ 973.615017] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.615017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.615017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.615017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.615017] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.615418] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.615418] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.615828] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.616159] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.616526] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.616774] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 60a35938-fe8e-4620-9353-a5b63fd49bb8 is going to be created. [ 973.644132] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.644374] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.644970] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.648276] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.648276] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.648276] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-60a35938-fe8e-4620-9353-a5b63fd49bb8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.674776] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.680051] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 635920e2-e4b8-477b-a72e-5ecaa5e866fb [ 973.680051] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.680375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.680375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.680467] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.680909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.680909] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:635920e2-e4b8-477b-a72e-5ecaa5e866fb already deleted. [ 973.680909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-635920e2-e4b8-477b-a72e-5ecaa5e866fb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.714287] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.714515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.714601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.714829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.716092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.716092] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26287d78-a077-45b2-9f9c-fbff1368c591 already deleted. [ 973.716092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.716092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.716092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.716092] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26287d78-a077-45b2-9f9c-fbff1368c591',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.180391] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.180666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.180666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.180888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.180945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.181035] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 974.212257] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.212257] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.212257] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.212257] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.212257] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.220627] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 974.236439] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.236592] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.236663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.236871] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.236961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.237109] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26287d78-a077-45b2-9f9c-fbff1368c591 already deleted. [ 974.237178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.356954] env[69637]: INFO networking_nsxv3.common.synchronization [req-5831b5b7-733c-49cd-a1ca-8ac42ff77c0c req-76ab4c92-a995-44bf-94fc-19c88f2398be service nova] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_rules [ 974.357249] env[69637]: INFO networking_nsxv3.common.synchronization [req-5831b5b7-733c-49cd-a1ca-8ac42ff77c0c req-76ab4c92-a995-44bf-94fc-19c88f2398be service nova] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 974.357413] env[69637]: INFO networking_nsxv3.common.synchronization [req-5831b5b7-733c-49cd-a1ca-8ac42ff77c0c req-76ab4c92-a995-44bf-94fc-19c88f2398be service nova] Enqueued Resource ID: 60a35938-fe8e-4620-9353-a5b63fd49bb8 with Priority: HIGHEST for action port [ 974.357641] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_rules [ 974.357769] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 974.357865] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a35938-fe8e-4620-9353-a5b63fd49bb8 with Priority: HIGHEST for action port [ 974.358477] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.358615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.358686] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.358880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.359060] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.360724] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.360724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.360844] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-60a35938-fe8e-4620-9353-a5b63fd49bb8 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.360945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60a35938-fe8e-4620-9353-a5b63fd49bb8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.361018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60a35938-fe8e-4620-9353-a5b63fd49bb8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.361192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60a35938-fe8e-4620-9353-a5b63fd49bb8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.361272] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60a35938-fe8e-4620-9353-a5b63fd49bb8',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.863246] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.863377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.863561] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60a35938-fe8e-4620-9353-a5b63fd49bb8 with status ACTIVE [ 974.863723] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.863829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.863893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.864167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.864265] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.864435] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.864531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.864593] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.864747] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.864838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.865131] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.865230] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.865290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.865430] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.865506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.865591] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60a35938-fe8e-4620-9353-a5b63fd49bb8 is going to be updated. [ 974.885462] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.885601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.885727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.885873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.886020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.886196] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60a35938-fe8e-4620-9353-a5b63fd49bb8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.232374] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 976.232654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.232809] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.233080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.233295] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.233446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.233585] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.233756] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.233872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.233997] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.736425] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.238731] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.741276] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.741460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.741534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.741741] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.741828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.741925] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 977.785900] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.786062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.786062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.786261] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.786398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.805541] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 979.358507] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 979.358507] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 979.471629] env[69637]: INFO networking_nsxv3.common.synchronization [req-8745b5b0-0b6d-4ea7-8bc4-c63ba7757886 req-889631da-d32c-40eb-b2b5-d0b8bdd42f80 tempest-ServerRescueTestJSON-1328189417 tempest-ServerRescueTestJSON-1328189417-project-member] Enqueued Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_members [ 979.472176] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_members [ 979.472872] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.472872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.472872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.472872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.473050] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.473148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.473210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.473352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.473434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.473527] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.853901] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 979.853994] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.854181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.854456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.854618] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.854741] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.854803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.854954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.855116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.855152] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.855243] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.975333] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.357206] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.358126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.358126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.358126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.358126] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.358126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.358126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.358512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.358512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.358512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.358512] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.358808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.358808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.358808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.358891] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.358978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.359018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.359155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.359297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.359297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.359403] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.477453] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.482467] env[69637]: INFO networking_nsxv3.common.synchronization [req-c9a442b8-ebb5-432c-a3c0-7b22c2d72960 req-1ea6820a-c2f0-4353-b271-e6f8488a7921 tempest-ServersAdminTestJSON-567435686 tempest-ServersAdminTestJSON-567435686-project-member] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 980.482713] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 980.483372] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.483502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.483572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.483767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.483911] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.484015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.484082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.484225] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.484309] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.484401] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.864747] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 156f33af-1675-4f7d-b99d-9e88f58f4cd2: rpc.has_security_group_logging(os_id): False [ 980.883501] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.883666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.883783] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.883958] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.884056] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.884242] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.884339] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.884404] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.884549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.884628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.884828] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.884948] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.885043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.885208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.885293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.885476] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.885585] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.885695] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.885821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.885903] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.886011] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 980.947517] env[69637]: INFO networking_nsxv3.common.synchronization [req-afec7894-f459-4385-b1d4-7e8126c12cae req-ee0ffd0e-7b48-4c20-963e-f6e7ed2aeabf tempest-ServerDiskConfigTestJSON-538739594 tempest-ServerDiskConfigTestJSON-538739594-project-member] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 980.948054] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 980.948395] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.948515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.948583] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.948785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.948955] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.949156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.949293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.949531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.949531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.949641] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.951213] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.951351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.951388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.951614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.952389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.967106] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 980.979644] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.979800] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.980270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.980270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.980270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.980270] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe is going to be updated. [ 980.986489] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.009708] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.009838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.009911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.012530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.012530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.018411] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe in Status: IN_PROGRESS for 2s [ 981.320951] env[69637]: INFO networking_nsxv3.common.synchronization [req-5de9848d-c131-40a3-bad7-6b8c1a0d7d30 req-4e87f365-82ff-4567-93c2-ac1c6e54c6d7 tempest-MigrationsAdminTest-855510084 tempest-MigrationsAdminTest-855510084-project-member] Enqueued Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_members [ 981.321646] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGHEST for action security_group_members [ 981.325866] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.326182] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.326294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.326563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.326797] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.326923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.327017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.327222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.327339] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.327470] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.397419] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-185 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.397681] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.397770] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.398045] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.398526] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.398526] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.398630] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.398799] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.398945] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.399165] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.400283] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.400283] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.400283] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.400283] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.400283] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.400283] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.416941] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.417129] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 981.417346] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.417603] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.417849] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-9466fcff-1b9a-4a47-8e86-910b8573fdb0 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.418049] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-9466fcff-1b9a-4a47-8e86-910b8573fdb0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.418183] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-9466fcff-1b9a-4a47-8e86-910b8573fdb0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.418550] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-9466fcff-1b9a-4a47-8e86-910b8573fdb0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.418711] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9466fcff-1b9a-4a47-8e86-910b8573fdb0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.455525] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.455743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.455853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.456167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.456317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.457445] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.457605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.457682] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.457864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.457955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.458141] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 981.488741] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.497368] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.497538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.497607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.497813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.497955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.508664] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 981.835575] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.835737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.835824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.836347] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.856773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.856998] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.857126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.857191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.857419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.857556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.857601] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 is going to be updated. [ 981.883725] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.883873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.883941] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.884155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.884295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.893680] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: IN_PROGRESS for 2s [ 981.920825] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.921068] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.921204] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.921476] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.921646] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.921785] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 9466fcff-1b9a-4a47-8e86-910b8573fdb0 not found, creating... [ 981.922052] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.922214] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.922332] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.922646] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.922700] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.922966] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.923146] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.923266] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.923487] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.923662] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.923896] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 9466fcff-1b9a-4a47-8e86-910b8573fdb0 is going to be created. [ 981.953025] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.953149] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.953192] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.953423] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.953647] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.953863] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-9466fcff-1b9a-4a47-8e86-910b8573fdb0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.991395] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.991563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.991635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.991836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.991925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.992035] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 is going to be updated. [ 982.019947] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.020143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.020201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.020371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.020513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.029282] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: IN_PROGRESS for 2s [ 982.638172] env[69637]: INFO networking_nsxv3.common.synchronization [req-afec7894-f459-4385-b1d4-7e8126c12cae req-a62c18b5-3fea-438b-817d-2a5adf4347f4 service nova] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_rules [ 982.638433] env[69637]: INFO networking_nsxv3.common.synchronization [req-afec7894-f459-4385-b1d4-7e8126c12cae req-a62c18b5-3fea-438b-817d-2a5adf4347f4 service nova] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 982.638556] env[69637]: INFO networking_nsxv3.common.synchronization [req-afec7894-f459-4385-b1d4-7e8126c12cae req-a62c18b5-3fea-438b-817d-2a5adf4347f4 service nova] Enqueued Resource ID: 9466fcff-1b9a-4a47-8e86-910b8573fdb0 with Priority: HIGHEST for action port [ 982.638782] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_rules [ 982.638914] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 982.639020] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9466fcff-1b9a-4a47-8e86-910b8573fdb0 with Priority: HIGHEST for action port [ 982.639567] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.639999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.640101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.640354] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.640443] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.642171] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.642171] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.642171] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-9466fcff-1b9a-4a47-8e86-910b8573fdb0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.642171] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9466fcff-1b9a-4a47-8e86-910b8573fdb0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.642171] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9466fcff-1b9a-4a47-8e86-910b8573fdb0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.642559] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9466fcff-1b9a-4a47-8e86-910b8573fdb0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.642559] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9466fcff-1b9a-4a47-8e86-910b8573fdb0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.988921] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 982.989195] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.028654] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe in Status: SUCCESS [ 983.028856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.144561] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.144710] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.146045] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9466fcff-1b9a-4a47-8e86-910b8573fdb0 with status ACTIVE [ 983.146591] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.146591] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.146591] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.146699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.146725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.146887] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.146985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.147058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.147212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.147348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.147541] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.147619] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.147690] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.147782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.147855] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.147939] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9466fcff-1b9a-4a47-8e86-910b8573fdb0 is going to be updated. [ 983.181032] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.181032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.181032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.181236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.181293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.181449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9466fcff-1b9a-4a47-8e86-910b8573fdb0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.203578] env[69637]: INFO networking_nsxv3.common.synchronization [req-76a00c6e-5c8e-4a5d-8dfb-4e9b5731ab47 req-a094644b-5fcc-4269-b354-16bd116e562d tempest-ServerTagsTestJSON-1283639049 tempest-ServerTagsTestJSON-1283639049-project-member] Enqueued Resource ID: da183859-be41-4684-a134-dc3c3fac0ab7 with Priority: HIGHEST for action security_group_members [ 983.203578] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da183859-be41-4684-a134-dc3c3fac0ab7 with Priority: HIGHEST for action security_group_members [ 983.203802] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-da183859-be41-4684-a134-dc3c3fac0ab7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.204109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.204109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.204276] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.205105] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.205105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.205105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.205105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.205105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.205105] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da183859-be41-4684-a134-dc3c3fac0ab7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.481416] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.481967] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-873" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.481967] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-873" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.482203] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-873" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.482538] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.482881] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.483054] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.483287] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.483437] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.483664] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.483745] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 983.483855] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 983.484070] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 983.484190] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.484300] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 983.484436] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 983.502810] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 983.502971] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 983.503120] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 983.503450] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-873" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.503764] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-e72f91a5-e84a-4860-88e9-519392f244f9 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.505031] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-e72f91a5-e84a-4860-88e9-519392f244f9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.505031] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-e72f91a5-e84a-4860-88e9-519392f244f9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.505031] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-e72f91a5-e84a-4860-88e9-519392f244f9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.505031] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e72f91a5-e84a-4860-88e9-519392f244f9',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.518336] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 983.518336] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac deletion is rescheduled due to dependency. [ 983.518336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.518336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.518472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.519445] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.519445] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.519445] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.519445] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.519445] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.519445] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.707110] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.707661] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.707661] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.707776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.707776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.707976] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.708092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.708164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.708348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.708434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.708519] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da183859-be41-4684-a134-dc3c3fac0ab7 already deleted. [ 983.708599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.902911] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 in Status: SUCCESS [ 983.903118] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 deletion is rescheduled due to dependency. [ 983.903235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.008100] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.008371] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.008504] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.008778] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.009038] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.009209] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port e72f91a5-e84a-4860-88e9-519392f244f9 not found, creating... [ 984.009473] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.009634] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.009768] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.009996] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.010155] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.010440] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.010598] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.010718] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.010929] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.011087] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.011229] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: e72f91a5-e84a-4860-88e9-519392f244f9 is going to be created. [ 984.022156] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.038884] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.040523] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.040523] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.040523] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.040523] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.040523] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-e72f91a5-e84a-4860-88e9-519392f244f9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.041817] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: SUCCESS [ 984.042127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.524110] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.870547] env[69637]: INFO networking_nsxv3.common.synchronization [req-9e612ae7-6f89-4269-a49c-8f9b8b4ce728 req-513a4354-b936-4257-8b21-dc725f968e0b tempest-ServersTestJSON-1659168521 tempest-ServersTestJSON-1659168521-project-member] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 984.872421] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 984.872747] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.872864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.872933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.873147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.873289] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.873389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.873449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.873611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.873700] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.873792] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.926346] env[69637]: INFO networking_nsxv3.common.synchronization [req-76a00c6e-5c8e-4a5d-8dfb-4e9b5731ab47 req-13c4e5b7-75ec-47b4-a5d5-cc68f1303155 service nova] Enqueued Resource ID: da183859-be41-4684-a134-dc3c3fac0ab7 with Priority: HIGHEST for action security_group_rules [ 984.926510] env[69637]: INFO networking_nsxv3.common.synchronization [req-76a00c6e-5c8e-4a5d-8dfb-4e9b5731ab47 req-13c4e5b7-75ec-47b4-a5d5-cc68f1303155 service nova] Enqueued Resource ID: da183859-be41-4684-a134-dc3c3fac0ab7 with Priority: HIGHEST for action security_group_members [ 984.926655] env[69637]: INFO networking_nsxv3.common.synchronization [req-76a00c6e-5c8e-4a5d-8dfb-4e9b5731ab47 req-13c4e5b7-75ec-47b4-a5d5-cc68f1303155 service nova] Enqueued Resource ID: e72f91a5-e84a-4860-88e9-519392f244f9 with Priority: HIGHEST for action port [ 984.927142] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da183859-be41-4684-a134-dc3c3fac0ab7 with Priority: HIGHEST for action security_group_rules [ 984.927276] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da183859-be41-4684-a134-dc3c3fac0ab7 with Priority: HIGHEST for action security_group_members [ 984.927376] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e72f91a5-e84a-4860-88e9-519392f244f9 with Priority: HIGHEST for action port [ 984.927678] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da183859-be41-4684-a134-dc3c3fac0ab7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.927802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.927870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.928477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.928576] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da183859-be41-4684-a134-dc3c3fac0ab7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.932203] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-da183859-be41-4684-a134-dc3c3fac0ab7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.932344] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.932421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.932615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.932773] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.932871] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.932933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.933102] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.933186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.933279] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da183859-be41-4684-a134-dc3c3fac0ab7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.934044] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-e72f91a5-e84a-4860-88e9-519392f244f9 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.934153] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e72f91a5-e84a-4860-88e9-519392f244f9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.934220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e72f91a5-e84a-4860-88e9-519392f244f9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.934369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e72f91a5-e84a-4860-88e9-519392f244f9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.934444] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e72f91a5-e84a-4860-88e9-519392f244f9',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.026631] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.026824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.026824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.027053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.027148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.027250] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 985.062695] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.062854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.062906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.063124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.063268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.073281] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 985.376031] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.436419] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-da183859-be41-4684-a134-dc3c3fac0ab7 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.436549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.436727] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da183859-be41-4684-a134-dc3c3fac0ab7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.437627] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e72f91a5-e84a-4860-88e9-519392f244f9 with status ACTIVE [ 985.437806] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.437919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.437985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.438197] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.438283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.438450] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.438551] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.438615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.438760] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.438888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.439019] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.439113] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.439172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.439301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.439374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.439481] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e72f91a5-e84a-4860-88e9-519392f244f9 is going to be updated. [ 985.458562] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.458666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.458738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.458930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.459074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.459231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e72f91a5-e84a-4860-88e9-519392f244f9" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.877802] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.942428] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da183859-be41-4684-a134-dc3c3fac0ab7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.082022] env[69637]: INFO networking_nsxv3.common.synchronization [req-38b0d9ba-e298-40db-b7a2-7c2a7331903a req-36b267a4-195e-4ee7-855b-5ea331a6b70e tempest-ServerActionsTestJSON-2076172663 tempest-ServerActionsTestJSON-2076172663-project-member] Enqueued Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 986.082022] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 986.082022] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.082022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.082022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.082022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.082022] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.082475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.082615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.082843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.083024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.083190] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.382672] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.382835] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.382905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.383143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.383231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.383330] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 986.410835] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.410992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.411077] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.411286] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.411432] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.419198] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 986.447762] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.447911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.447983] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.448201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.448287] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.448381] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da183859-be41-4684-a134-dc3c3fac0ab7 is going to be created. [ 986.469453] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.469586] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.469659] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.469871] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.470038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.480555] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da183859-be41-4684-a134-dc3c3fac0ab7 in Status: UNINITIALIZED for 2s [ 986.586967] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.587190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.587282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.587545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.587661] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.587890] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.588029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.588113] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.588282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.588425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.588504] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 already deleted. [ 986.588614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.594482] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-970 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.594482] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.594482] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.594605] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.594856] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.595011] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.595129] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.597628] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.597628] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.597628] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.597628] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.597628] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.597628] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.597628] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.597628] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.597628] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.616513] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.616513] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 986.616513] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.616696] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.616998] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-37f2faf7-5e71-48d9-bd4e-9b6e4415ba96 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.617183] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-37f2faf7-5e71-48d9-bd4e-9b6e4415ba96" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.617303] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-37f2faf7-5e71-48d9-bd4e-9b6e4415ba96" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.617634] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-37f2faf7-5e71-48d9-bd4e-9b6e4415ba96" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.617775] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37f2faf7-5e71-48d9-bd4e-9b6e4415ba96',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.082677] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 987.083083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.083144] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.083366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.083555] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.083685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.083723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.083869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.083949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.084053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.084144] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.123658] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.123859] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.123989] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.124282] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.124510] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.124679] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 37f2faf7-5e71-48d9-bd4e-9b6e4415ba96 not found, creating... [ 987.124955] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.125128] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.125251] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.125485] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.125628] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.125934] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.126122] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.126248] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.126461] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.126602] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.126744] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 37f2faf7-5e71-48d9-bd4e-9b6e4415ba96 is going to be created. [ 987.144665] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.144900] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.145035] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.145314] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.145549] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.145773] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-37f2faf7-5e71-48d9-bd4e-9b6e4415ba96" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.586107] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.586278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.586352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.586592] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.586763] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.586862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.586926] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.587120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.587173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.587261] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.587408] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.587639] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.587745] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.587914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.588089] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.588199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.588266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.588413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.588533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.588805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.588805] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.927017] env[69637]: INFO networking_nsxv3.common.synchronization [req-38b0d9ba-e298-40db-b7a2-7c2a7331903a req-75f2157f-f7de-4db6-84fe-878da5351469 service nova] Enqueued Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_rules [ 987.927017] env[69637]: INFO networking_nsxv3.common.synchronization [req-38b0d9ba-e298-40db-b7a2-7c2a7331903a req-75f2157f-f7de-4db6-84fe-878da5351469 service nova] Enqueued Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 987.927017] env[69637]: INFO networking_nsxv3.common.synchronization [req-38b0d9ba-e298-40db-b7a2-7c2a7331903a req-75f2157f-f7de-4db6-84fe-878da5351469 service nova] Enqueued Resource ID: 37f2faf7-5e71-48d9-bd4e-9b6e4415ba96 with Priority: HIGHEST for action port [ 987.927017] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_rules [ 987.927017] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 987.927017] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37f2faf7-5e71-48d9-bd4e-9b6e4415ba96 with Priority: HIGHEST for action port [ 987.927394] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.927394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.927394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.927618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.927664] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.928823] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.928944] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.929014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.929185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.929323] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.929413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.929472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.929610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.929689] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.929773] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.930521] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-37f2faf7-5e71-48d9-bd4e-9b6e4415ba96 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.930658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37f2faf7-5e71-48d9-bd4e-9b6e4415ba96" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.930745] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37f2faf7-5e71-48d9-bd4e-9b6e4415ba96" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.930919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37f2faf7-5e71-48d9-bd4e-9b6e4415ba96" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.930999] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37f2faf7-5e71-48d9-bd4e-9b6e4415ba96',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.091289] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bac27816-ae12-436b-86da-6c4bbde7b2ac: rpc.has_security_group_logging(os_id): False [ 988.111097] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.111240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.111311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.111596] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.111672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.114603] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.114603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.114603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.114603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.114603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.114603] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.114603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.114603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.114603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.114603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.114603] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.114603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.114603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.114603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.115728] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.115728] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 988.169291] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.169291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.169291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.169291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.169291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.176679] env[69637]: INFO networking_nsxv3.common.synchronization [req-04ebf222-91f7-4160-bb3b-3c814b95330c req-21257dfe-3d22-4ab1-9ded-f560300be928 tempest-ImagesTestJSON-1924392618 tempest-ImagesTestJSON-1924392618-project-member] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 988.176910] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 988.177217] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.178050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.178050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.178050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.178050] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.178050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.178050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.178315] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.178315] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.178315] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.179751] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 988.429508] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 988.429838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.432215] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.433222] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.433320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.433504] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37f2faf7-5e71-48d9-bd4e-9b6e4415ba96 with status ACTIVE [ 988.433685] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.433828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.433926] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.434180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.434264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.434431] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.434528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.434590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.434738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.434815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.434993] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.435638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.435710] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.436120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.436120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.436120] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37f2faf7-5e71-48d9-bd4e-9b6e4415ba96 is going to be updated. [ 988.456543] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.456697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.456770] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.456984] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.457181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.457359] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37f2faf7-5e71-48d9-bd4e-9b6e4415ba96" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.489582] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da183859-be41-4684-a134-dc3c3fac0ab7 in Status: SUCCESS [ 988.489856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.490060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.490276] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.490466] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.490578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.490640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.490798] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.490878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.490969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.491089] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da183859-be41-4684-a134-dc3c3fac0ab7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.508952] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.509173] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.510024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.510024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.510143] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.510339] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.510382] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.510589] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.510746] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.510962] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 988.511590] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 988.512038] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 988.512038] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 988.512038] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 988.512181] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 988.512231] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 988.530088] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 988.530463] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 988.530463] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 988.530744] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-156" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.531068] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-31499301-e276-4b97-87f0-a5cc541c5b46 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.531264] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-31499301-e276-4b97-87f0-a5cc541c5b46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.531612] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-31499301-e276-4b97-87f0-a5cc541c5b46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.531695] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-31499301-e276-4b97-87f0-a5cc541c5b46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.531864] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31499301-e276-4b97-87f0-a5cc541c5b46',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.681711] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.681907] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.681985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.682233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.682327] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.682530] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.683408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.683408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.683408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.683408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.683408] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 988.706317] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.706317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.706317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.706504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.706670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.715668] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 988.938824] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.993082] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-da183859-be41-4684-a134-dc3c3fac0ab7 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.993250] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.993322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.993535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.993704] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.993806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.993870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.994023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.994112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.994200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.994345] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-da183859-be41-4684-a134-dc3c3fac0ab7 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.994438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.994503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.994645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.994780] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.994869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.994924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.995078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.995157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.995240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.995328] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da183859-be41-4684-a134-dc3c3fac0ab7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.033898] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.034439] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.034439] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.035241] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.035241] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.035241] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 31499301-e276-4b97-87f0-a5cc541c5b46 not found, creating... [ 989.035241] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.035619] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.035619] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.035747] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.035905] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.036616] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.036806] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.036934] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.037184] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.037341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.037486] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 31499301-e276-4b97-87f0-a5cc541c5b46 is going to be created. [ 989.059482] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.060152] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.060402] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.060782] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.061188] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.061559] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-31499301-e276-4b97-87f0-a5cc541c5b46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.196158] env[69637]: INFO networking_nsxv3.common.synchronization [req-1318bcf7-cdb9-4f1c-b2a2-6926440f9c3b req-a3401ade-8741-4f78-b199-8469e1c463ad tempest-ServersWithSpecificFlavorTestJSON-315105085 tempest-ServersWithSpecificFlavorTestJSON-315105085-project-member] Enqueued Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_members [ 989.196679] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_members [ 989.196987] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-108f5aaf-b223-4e3b-b27d-aa7c7e251598 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.197125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.197193] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.197390] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.197567] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.197664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.197729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.197878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.197962] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.198087] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.441055] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.441243] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.441356] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.441499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.441614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.441696] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 is going to be created. [ 989.464156] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.464350] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.464350] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.464628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.464845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.473891] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: UNINITIALIZED for 2s [ 989.498622] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da183859-be41-4684-a134-dc3c3fac0ab7: rpc.has_security_group_logging(os_id): False [ 989.517049] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.517252] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.517305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.517563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.517693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.517888] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.517989] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.518089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.518256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.518339] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.518536] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.518657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.518720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.518868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.518946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.519194] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.519432] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.519432] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.519491] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.519571] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.519639] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da183859-be41-4684-a134-dc3c3fac0ab7 is going to be created. [ 989.585552] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.585769] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.585843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.586463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.586811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.599150] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da183859-be41-4684-a134-dc3c3fac0ab7 in Status: IN_PROGRESS for 2s [ 989.700383] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.700557] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.700635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.700836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.700920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.701148] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.701245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.701358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.701462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.701545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.701628] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 is going to be updated. [ 989.733752] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.733923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.733986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.734228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.734370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.744731] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 in Status: IN_PROGRESS for 2s [ 989.790413] env[69637]: INFO networking_nsxv3.common.synchronization [req-04ebf222-91f7-4160-bb3b-3c814b95330c req-7bb48a6c-336d-4a33-b80d-ab8e7247cc4c service nova] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_rules [ 989.790652] env[69637]: INFO networking_nsxv3.common.synchronization [req-04ebf222-91f7-4160-bb3b-3c814b95330c req-7bb48a6c-336d-4a33-b80d-ab8e7247cc4c service nova] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 989.790803] env[69637]: INFO networking_nsxv3.common.synchronization [req-04ebf222-91f7-4160-bb3b-3c814b95330c req-7bb48a6c-336d-4a33-b80d-ab8e7247cc4c service nova] Enqueued Resource ID: 31499301-e276-4b97-87f0-a5cc541c5b46 with Priority: HIGHEST for action port [ 989.790987] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_rules [ 989.791161] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 989.791260] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31499301-e276-4b97-87f0-a5cc541c5b46 with Priority: HIGHEST for action port [ 989.791825] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.791958] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.792037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.792674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.792674] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.793541] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.793645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.793832] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-31499301-e276-4b97-87f0-a5cc541c5b46 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.793926] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31499301-e276-4b97-87f0-a5cc541c5b46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.793999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31499301-e276-4b97-87f0-a5cc541c5b46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.795455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31499301-e276-4b97-87f0-a5cc541c5b46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.795455] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31499301-e276-4b97-87f0-a5cc541c5b46',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.195197] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 990.195497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.295977] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.296386] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.298660] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31499301-e276-4b97-87f0-a5cc541c5b46 with status ACTIVE [ 990.299072] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.299348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.299470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.299784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.299953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.300250] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.300415] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.300521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.300775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.300900] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.301237] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.301384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.301577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.301660] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.301823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.302180] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31499301-e276-4b97-87f0-a5cc541c5b46 is going to be updated. [ 990.326959] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.327133] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.327221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.327404] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.327629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.327929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31499301-e276-4b97-87f0-a5cc541c5b46" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.725211] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 990.725610] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 deletion is rescheduled due to dependency. [ 990.725610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.725846] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.726097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.726676] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.726676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.726676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.726676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.726998] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.726998] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.229287] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.483520] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: SUCCESS [ 991.483817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.483946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.484304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.484401] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.484528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.484608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.484767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.484862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.484951] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.485057] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.612563] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da183859-be41-4684-a134-dc3c3fac0ab7 in Status: SUCCESS [ 991.612563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.731592] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.753733] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 in Status: SUCCESS [ 991.753923] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 deletion is rescheduled due to dependency. [ 991.754121] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.986981] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.235028] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.235028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.235028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.235028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.235028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.235028] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 992.265926] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.266098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.266098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.266278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.266430] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.275263] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 992.489223] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6b27dfc-30ce-43c0-922c-60d619d56e60: rpc.has_security_group_logging(os_id): False [ 992.506862] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.507034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.507119] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.507387] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.507504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.508404] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.508404] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.508404] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.508404] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.508404] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.508404] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 is going to be created. [ 992.563963] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.564137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.564211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.564427] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.564624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.575840] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: IN_PROGRESS for 2s [ 992.881865] env[69637]: INFO networking_nsxv3.common.synchronization [req-38a946d6-f7f2-46b8-8852-e437fe57fe62 req-ea727ea3-5f20-4084-baab-aa377fb1217e tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_members [ 992.884439] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_members [ 992.884439] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e078c82-40fd-4661-9911-198585d187a7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.884439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.884439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.884439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.884439] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.884439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.884439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.884439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.884439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.884439] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.386763] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.387472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.387472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.387472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.387472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.387601] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.387854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.387854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.387928] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.387993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.388063] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e078c82-40fd-4661-9911-198585d187a7 already deleted. [ 993.388138] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.425337] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-149 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.425621] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.425727] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.426020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.426304] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.426442] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.426563] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.426789] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.426996] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.427169] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.427305] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.427472] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.427602] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.427743] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.427943] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.427943] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.445295] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.445519] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 993.445682] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.445889] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.446229] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-9a008314-43f0-4cb2-a9a4-a18100b15b68 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.446411] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-9a008314-43f0-4cb2-a9a4-a18100b15b68" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.446533] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-9a008314-43f0-4cb2-a9a4-a18100b15b68" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.446875] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-9a008314-43f0-4cb2-a9a4-a18100b15b68" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.446999] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a008314-43f0-4cb2-a9a4-a18100b15b68',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.953470] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.953470] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.953470] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.953470] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.953470] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.953470] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 9a008314-43f0-4cb2-a9a4-a18100b15b68 not found, creating... [ 993.953470] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.953470] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.953470] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.953470] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.953470] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.954152] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.954152] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.954152] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.954152] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.954152] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.954152] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 9a008314-43f0-4cb2-a9a4-a18100b15b68 is going to be created. [ 993.973868] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.974741] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.974741] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.974741] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.974912] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.975173] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-9a008314-43f0-4cb2-a9a4-a18100b15b68" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.285753] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 994.285957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.286140] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.286347] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.286535] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.286648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.286716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.286862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.286963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.287066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.287158] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.590294] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: SUCCESS [ 994.590294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.792498] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.792498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.792498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.792498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.792498] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.792498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.792498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.792498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.792498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.792498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.792498] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.792498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.792498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.792498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.792498] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.792498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.793549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.793549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.793549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.793549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.793549] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.794075] env[69637]: INFO networking_nsxv3.common.synchronization [req-38a946d6-f7f2-46b8-8852-e437fe57fe62 req-b52db372-bb5b-4df3-b9e9-d11e29c67928 service nova] Enqueued Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_rules [ 994.794320] env[69637]: INFO networking_nsxv3.common.synchronization [req-38a946d6-f7f2-46b8-8852-e437fe57fe62 req-b52db372-bb5b-4df3-b9e9-d11e29c67928 service nova] Enqueued Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_members [ 994.794320] env[69637]: INFO networking_nsxv3.common.synchronization [req-38a946d6-f7f2-46b8-8852-e437fe57fe62 req-b52db372-bb5b-4df3-b9e9-d11e29c67928 service nova] Enqueued Resource ID: 9a008314-43f0-4cb2-a9a4-a18100b15b68 with Priority: HIGHEST for action port [ 994.794712] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_rules [ 994.794834] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_members [ 994.794926] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a008314-43f0-4cb2-a9a4-a18100b15b68 with Priority: HIGHEST for action port [ 994.795418] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e078c82-40fd-4661-9911-198585d187a7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.795526] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.795607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.795881] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.795881] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.797080] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e078c82-40fd-4661-9911-198585d187a7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.797250] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.797606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.797606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.797856] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.798137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.798378] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.798577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.798827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.798827] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.800958] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a008314-43f0-4cb2-a9a4-a18100b15b68 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.801097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a008314-43f0-4cb2-a9a4-a18100b15b68" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.801203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a008314-43f0-4cb2-a9a4-a18100b15b68" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.801460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a008314-43f0-4cb2-a9a4-a18100b15b68" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.801460] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a008314-43f0-4cb2-a9a4-a18100b15b68',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.296786] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc8c512a-6092-4e87-9d42-efdd0a8ab3f4: rpc.has_security_group_logging(os_id): False [ 995.304052] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.304316] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e078c82-40fd-4661-9911-198585d187a7 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.304435] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.304593] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a008314-43f0-4cb2-a9a4-a18100b15b68 with status ACTIVE [ 995.304750] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.304859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.304923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.305140] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.305229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.305402] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.305500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.305563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.305742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.305820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.305998] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.306485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.306554] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.306706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.306915] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.307019] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a008314-43f0-4cb2-a9a4-a18100b15b68 is going to be updated. [ 995.316778] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.316918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.317107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.317272] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.317386] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.317667] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.320082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.320082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.320082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.320082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.320082] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.320082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.320082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.320082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.320082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.320082] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.320082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.320082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.320082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.320082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.320082] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 995.326442] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.326897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.326897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.326897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.326897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.327307] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a008314-43f0-4cb2-a9a4-a18100b15b68" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.399983] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.400147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.400217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.400544] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.400544] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.413607] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 995.809575] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.315346] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.315346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.315346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.315346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.315346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.315346] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e078c82-40fd-4661-9911-198585d187a7 is going to be created. [ 996.339335] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.339335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.339335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.339335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.339335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.347654] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e078c82-40fd-4661-9911-198585d187a7 in Status: UNINITIALIZED for 2s [ 997.273028] env[69637]: INFO networking_nsxv3.common.synchronization [req-d0485e3a-876f-4eeb-98c9-e0750b2e1357 req-a34d60f1-9dcd-4831-be1e-592909e132b1 tempest-InstanceActionsTestJSON-276135571 tempest-InstanceActionsTestJSON-276135571-project-member] Enqueued Resource ID: 8d51299a-8425-4d04-b702-fb6eebeef65f with Priority: HIGHEST for action security_group_members [ 997.273612] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d51299a-8425-4d04-b702-fb6eebeef65f with Priority: HIGHEST for action security_group_members [ 997.273939] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d51299a-8425-4d04-b702-fb6eebeef65f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.275225] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.275338] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.275511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.276027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.276159] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.276286] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.276452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.276565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.276681] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d51299a-8425-4d04-b702-fb6eebeef65f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.426789] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 997.427063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.683035] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-439 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.683035] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-439" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.683035] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-439" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.683257] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-439" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.683595] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.686221] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.686742] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.687885] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.688094] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.688397] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 997.689650] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.689650] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.689650] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.689650] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 997.689821] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.690572] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.710020] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.710222] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 997.710353] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.710533] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-439" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.710863] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-d7a2d253-6496-477d-8946-cbd76d918a48 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.711060] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-d7a2d253-6496-477d-8946-cbd76d918a48" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.711187] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-d7a2d253-6496-477d-8946-cbd76d918a48" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.711516] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-d7a2d253-6496-477d-8946-cbd76d918a48" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.711660] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7a2d253-6496-477d-8946-cbd76d918a48',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.781375] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.781375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.781375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.781538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.781538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.781735] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.781847] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.782038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.782109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.782182] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.782264] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d51299a-8425-4d04-b702-fb6eebeef65f already deleted. [ 997.782342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.978309] env[69637]: INFO networking_nsxv3.common.synchronization [req-7f0ab540-76d4-469c-b3fe-55182c7a1d91 req-949fcb75-334e-4391-9cd2-87dcd2fa6082 tempest-ServerTagsTestJSON-1283639049 tempest-ServerTagsTestJSON-1283639049-project-member] Enqueued Resource ID: da183859-be41-4684-a134-dc3c3fac0ab7 with Priority: HIGHEST for action security_group_members [ 997.979372] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da183859-be41-4684-a134-dc3c3fac0ab7 with Priority: HIGHEST for action security_group_members [ 997.979372] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-da183859-be41-4684-a134-dc3c3fac0ab7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.979372] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.979568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.980268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.980677] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.980677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.980677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.980955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.981694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.981821] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da183859-be41-4684-a134-dc3c3fac0ab7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.218690] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.218968] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.219148] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.219437] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.219589] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.219754] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port d7a2d253-6496-477d-8946-cbd76d918a48 not found, creating... [ 998.220044] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.220210] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.220332] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.220546] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.220686] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.220966] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.221137] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.221257] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.221462] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.221597] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.221738] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: d7a2d253-6496-477d-8946-cbd76d918a48 is going to be created. [ 998.242049] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.242371] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.242533] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.242672] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.242900] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.243126] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-d7a2d253-6496-477d-8946-cbd76d918a48" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.357644] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e078c82-40fd-4661-9911-198585d187a7 in Status: SUCCESS [ 998.357905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.358169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.358298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.358480] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.358593] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.358656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.358824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.358939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.359048] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.359143] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.523164] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.523499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.523499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.523614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.523659] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.523826] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.523921] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.523971] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.524128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.524201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.524284] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da183859-be41-4684-a134-dc3c3fac0ab7 is going to be updated. [ 998.549201] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.549380] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.549442] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.549623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.549759] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.559198] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da183859-be41-4684-a134-dc3c3fac0ab7 in Status: IN_PROGRESS for 2s [ 998.861692] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.363992] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e078c82-40fd-4661-9911-198585d187a7: rpc.has_security_group_logging(os_id): False [ 999.381661] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.381791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.381843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.382062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.382154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.382401] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.382499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.382561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.382703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.382778] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.382862] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e078c82-40fd-4661-9911-198585d187a7 is going to be created. [ 999.439198] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.439408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.439408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.439598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.439774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.449747] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e078c82-40fd-4661-9911-198585d187a7 in Status: IN_PROGRESS for 2s [ 999.657264] env[69637]: INFO networking_nsxv3.common.synchronization [req-d0485e3a-876f-4eeb-98c9-e0750b2e1357 req-1e0c260c-ef63-41c4-b417-82401bc3b2bc service nova] Enqueued Resource ID: 8d51299a-8425-4d04-b702-fb6eebeef65f with Priority: HIGHEST for action security_group_rules [ 999.657518] env[69637]: INFO networking_nsxv3.common.synchronization [req-d0485e3a-876f-4eeb-98c9-e0750b2e1357 req-1e0c260c-ef63-41c4-b417-82401bc3b2bc service nova] Enqueued Resource ID: 8d51299a-8425-4d04-b702-fb6eebeef65f with Priority: HIGHEST for action security_group_members [ 999.657585] env[69637]: INFO networking_nsxv3.common.synchronization [req-d0485e3a-876f-4eeb-98c9-e0750b2e1357 req-1e0c260c-ef63-41c4-b417-82401bc3b2bc service nova] Enqueued Resource ID: d7a2d253-6496-477d-8946-cbd76d918a48 with Priority: HIGHEST for action port [ 999.657817] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d51299a-8425-4d04-b702-fb6eebeef65f with Priority: HIGHEST for action security_group_rules [ 999.658009] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d51299a-8425-4d04-b702-fb6eebeef65f with Priority: HIGHEST for action security_group_members [ 999.658120] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7a2d253-6496-477d-8946-cbd76d918a48 with Priority: HIGHEST for action port [ 999.658659] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d51299a-8425-4d04-b702-fb6eebeef65f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.658782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.658903] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.659299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.659397] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d51299a-8425-4d04-b702-fb6eebeef65f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.660247] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d51299a-8425-4d04-b702-fb6eebeef65f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.660530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.660530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.660735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.660903] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.661030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.661114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.661276] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.661382] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.661490] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d51299a-8425-4d04-b702-fb6eebeef65f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.662287] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7a2d253-6496-477d-8946-cbd76d918a48 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.662435] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7a2d253-6496-477d-8946-cbd76d918a48" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.662524] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7a2d253-6496-477d-8946-cbd76d918a48" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.662693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7a2d253-6496-477d-8946-cbd76d918a48" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.662787] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7a2d253-6496-477d-8946-cbd76d918a48',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.889830] env[69637]: INFO networking_nsxv3.common.synchronization [req-363107e3-4df9-446f-9dcc-988ea4bd9fb9 req-39fa32b7-fea9-4a2a-bad4-2a3c38aad3ec tempest-ServersNegativeTestJSON-962136673 tempest-ServersNegativeTestJSON-962136673-project-member] Enqueued Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_members [ 999.890183] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_members [ 999.890475] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.890599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.890665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.890930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.891224] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.891332] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.891397] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.891561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.891644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.891739] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.167019] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d51299a-8425-4d04-b702-fb6eebeef65f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.167019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.167019] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d51299a-8425-4d04-b702-fb6eebeef65f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.167512] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7a2d253-6496-477d-8946-cbd76d918a48 with status ACTIVE [ 1000.167709] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.168417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.168417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.168417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.168417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.168417] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.168623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.168623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.168702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.168777] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.168955] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.169067] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.169118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.169255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.169324] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.169405] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7a2d253-6496-477d-8946-cbd76d918a48 is going to be updated. [ 1000.197537] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.197701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.197771] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.198336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.198484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.198635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7a2d253-6496-477d-8946-cbd76d918a48" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.347953] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-576 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.348214] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.348488] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.348578] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.348881] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.349093] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.349346] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.349346] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.349575] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.349774] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.349891] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1000.350068] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1000.350132] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1000.350239] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.350333] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1000.350450] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.375168] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.375168] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1000.375168] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.375168] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.375168] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-a208b322-f53f-45dc-8743-d84b6780724f taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.375168] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.375168] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.375168] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.375168] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a208b322-f53f-45dc-8743-d84b6780724f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.395754] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.395754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.395754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.395754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.395754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.395754] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.395754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.395754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.395754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.395754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.395754] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dab7827-c31f-472b-b986-30803c457337 already deleted. [ 1000.395754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.567022] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da183859-be41-4684-a134-dc3c3fac0ab7 in Status: SUCCESS [ 1000.567022] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da183859-be41-4684-a134-dc3c3fac0ab7 deletion is rescheduled due to dependency. [ 1000.567022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.675784] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d51299a-8425-4d04-b702-fb6eebeef65f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.877772] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.877772] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.877772] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.878332] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.878332] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.878332] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port a208b322-f53f-45dc-8743-d84b6780724f not found, creating... [ 1000.878498] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.878712] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.878777] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.879041] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.879186] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.879477] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.879632] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.879748] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.879959] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.880106] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.880308] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: a208b322-f53f-45dc-8743-d84b6780724f is going to be created. [ 1000.900985] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.901268] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.901515] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.901875] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.902208] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.902505] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.180683] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.180683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.180683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.180683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.180683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.180683] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d51299a-8425-4d04-b702-fb6eebeef65f is going to be created. [ 1001.204826] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.204826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.204826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.205023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.205023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.214192] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d51299a-8425-4d04-b702-fb6eebeef65f in Status: UNINITIALIZED for 2s [ 1001.461962] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e078c82-40fd-4661-9911-198585d187a7 in Status: SUCCESS [ 1001.462543] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.593555] env[69637]: INFO networking_nsxv3.common.synchronization [req-363107e3-4df9-446f-9dcc-988ea4bd9fb9 req-8291e245-4a65-44e2-91dd-e913cd1f4e87 service nova] Enqueued Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_rules [ 1001.593555] env[69637]: INFO networking_nsxv3.common.synchronization [req-363107e3-4df9-446f-9dcc-988ea4bd9fb9 req-8291e245-4a65-44e2-91dd-e913cd1f4e87 service nova] Enqueued Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_members [ 1001.593555] env[69637]: INFO networking_nsxv3.common.synchronization [req-363107e3-4df9-446f-9dcc-988ea4bd9fb9 req-8291e245-4a65-44e2-91dd-e913cd1f4e87 service nova] Enqueued Resource ID: a208b322-f53f-45dc-8743-d84b6780724f with Priority: HIGHEST for action port [ 1001.593555] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_rules [ 1001.593555] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_members [ 1001.593555] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a208b322-f53f-45dc-8743-d84b6780724f with Priority: HIGHEST for action port [ 1001.593555] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.595512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.595512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.595512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.595512] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.595679] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.595679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.595760] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.595925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.596067] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.596161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.596228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.597291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.597291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.597291] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.598069] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-a208b322-f53f-45dc-8743-d84b6780724f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.598069] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.598069] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.598236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.598455] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a208b322-f53f-45dc-8743-d84b6780724f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.103021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.103021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.103021] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.103021] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a208b322-f53f-45dc-8743-d84b6780724f with status ACTIVE [ 1002.103021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.103021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.103021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.103021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.103021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.103021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.103021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.103021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.103021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.105212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.105508] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.105723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.105870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.106109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.106267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.106436] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a208b322-f53f-45dc-8743-d84b6780724f is going to be updated. [ 1002.126234] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.126407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.126499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.126719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.126901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.127101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.609817] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.111435] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.111723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.111723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.115024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.115024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.115024] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dab7827-c31f-472b-b986-30803c457337 is going to be created. [ 1003.137706] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.137856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.137912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.138179] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.138343] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.148686] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: UNINITIALIZED for 2s [ 1003.226168] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d51299a-8425-4d04-b702-fb6eebeef65f in Status: SUCCESS [ 1003.226168] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.226168] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.227274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.227788] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.229168] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.229763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.229763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.229763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.229763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.229763] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d51299a-8425-4d04-b702-fb6eebeef65f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.505515] env[69637]: INFO networking_nsxv3.common.synchronization [req-d28bcf31-9f69-46d7-a4dc-ce5aa22f40bc req-0fa2d440-9a54-4b91-8f74-79642d996506 tempest-ServerActionsTestOtherA-1708466346 tempest-ServerActionsTestOtherA-1708466346-project-member] Enqueued Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGHEST for action security_group_members [ 1003.505718] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGHEST for action security_group_members [ 1003.506158] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-506fca2b-4bdc-418f-be44-db369f7e1332 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.506303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.506371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.506626] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.506802] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.506919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.507097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.507148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.507242] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.507379] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('506fca2b-4bdc-418f-be44-db369f7e1332',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.547284] env[69637]: INFO networking_nsxv3.common.synchronization [None req-51f3a5d9-58a9-4448-b884-b0d894c19734 None None] Enqueued Resource ID: 2f588adb-7892-49cd-b2fa-4f7dab7db9e2 with Priority: HIGHEST for action port [ 1003.548336] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f588adb-7892-49cd-b2fa-4f7dab7db9e2 with Priority: HIGHEST for action port [ 1003.548798] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f588adb-7892-49cd-b2fa-4f7dab7db9e2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.548798] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f588adb-7892-49cd-b2fa-4f7dab7db9e2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.548924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f588adb-7892-49cd-b2fa-4f7dab7db9e2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.549157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f588adb-7892-49cd-b2fa-4f7dab7db9e2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.549270] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f588adb-7892-49cd-b2fa-4f7dab7db9e2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.732131] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d51299a-8425-4d04-b702-fb6eebeef65f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.732131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.732131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.732407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.732553] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.732616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.732679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.732855] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.732934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.733047] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.733217] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d51299a-8425-4d04-b702-fb6eebeef65f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.733631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.733764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.733878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.734009] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.734281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.734357] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.734569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.734668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.734771] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.734880] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d51299a-8425-4d04-b702-fb6eebeef65f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.840717] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-310 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.840915] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.841073] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.841321] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.841602] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.841791] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.841924] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.842882] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.842882] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.843026] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.843559] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.843559] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.843559] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.843559] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.843865] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.843865] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.865964] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.865964] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1003.865964] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.865964] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.865964] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-78a0cd90-a426-4a79-b9b2-dabd1cdaa560 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.865964] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-78a0cd90-a426-4a79-b9b2-dabd1cdaa560" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.866557] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-78a0cd90-a426-4a79-b9b2-dabd1cdaa560" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.866557] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-78a0cd90-a426-4a79-b9b2-dabd1cdaa560" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.866557] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78a0cd90-a426-4a79-b9b2-dabd1cdaa560',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.009817] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.010150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.011047] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.012083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.012083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.012083] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.012083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.012083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.012083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.012083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.012442] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 506fca2b-4bdc-418f-be44-db369f7e1332 already deleted. [ 1004.012442] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.053702] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f588adb-7892-49cd-b2fa-4f7dab7db9e2 [ 1004.053702] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.053702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.053702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.053702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.053702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.053702] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f588adb-7892-49cd-b2fa-4f7dab7db9e2 already deleted. [ 1004.053702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f588adb-7892-49cd-b2fa-4f7dab7db9e2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.238307] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d51299a-8425-4d04-b702-fb6eebeef65f: rpc.has_security_group_logging(os_id): False [ 1004.268290] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.268290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.268290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.268290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.268290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.268290] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.268290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.268290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.268290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.268609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.268609] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.268725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.268725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.268862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.268905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.269076] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.269164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.269219] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.269401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.269457] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.269501] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d51299a-8425-4d04-b702-fb6eebeef65f is going to be created. [ 1004.347658] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.347795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.347858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.348131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.348314] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.360748] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d51299a-8425-4d04-b702-fb6eebeef65f in Status: IN_PROGRESS for 2s [ 1004.369153] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.369384] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.369906] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.369906] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.370089] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.370156] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 78a0cd90-a426-4a79-b9b2-dabd1cdaa560 not found, creating... [ 1004.370391] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.370564] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.370684] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.370916] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.371070] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.371391] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.372210] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.372290] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.372562] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.372739] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.372890] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 78a0cd90-a426-4a79-b9b2-dabd1cdaa560 is going to be created. [ 1004.400728] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.400728] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.400728] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.400936] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.401121] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.401350] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-78a0cd90-a426-4a79-b9b2-dabd1cdaa560" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.113826] env[69637]: INFO networking_nsxv3.common.synchronization [req-d28bcf31-9f69-46d7-a4dc-ce5aa22f40bc req-8028a1d7-7b5f-499f-b21a-2b013a27845e service nova] Enqueued Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGHEST for action security_group_rules [ 1005.114095] env[69637]: INFO networking_nsxv3.common.synchronization [req-d28bcf31-9f69-46d7-a4dc-ce5aa22f40bc req-8028a1d7-7b5f-499f-b21a-2b013a27845e service nova] Enqueued Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGHEST for action security_group_members [ 1005.114276] env[69637]: INFO networking_nsxv3.common.synchronization [req-d28bcf31-9f69-46d7-a4dc-ce5aa22f40bc req-8028a1d7-7b5f-499f-b21a-2b013a27845e service nova] Enqueued Resource ID: 78a0cd90-a426-4a79-b9b2-dabd1cdaa560 with Priority: HIGHEST for action port [ 1005.115122] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGHEST for action security_group_rules [ 1005.117382] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGHEST for action security_group_members [ 1005.117553] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a0cd90-a426-4a79-b9b2-dabd1cdaa560 with Priority: HIGHEST for action port [ 1005.119496] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-506fca2b-4bdc-418f-be44-db369f7e1332 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.119496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.119496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.119496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.119496] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('506fca2b-4bdc-418f-be44-db369f7e1332',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.119717] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-506fca2b-4bdc-418f-be44-db369f7e1332 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.119806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.119853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.120668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.120668] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.120790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.120790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.120969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.121045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.121137] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('506fca2b-4bdc-418f-be44-db369f7e1332',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.122076] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-78a0cd90-a426-4a79-b9b2-dabd1cdaa560 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.122205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78a0cd90-a426-4a79-b9b2-dabd1cdaa560" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.122205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78a0cd90-a426-4a79-b9b2-dabd1cdaa560" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.122406] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78a0cd90-a426-4a79-b9b2-dabd1cdaa560" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.122491] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78a0cd90-a426-4a79-b9b2-dabd1cdaa560',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.160748] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: SUCCESS [ 1005.161037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.161224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.161447] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.161668] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.161820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.162258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.162437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.162525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.162628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.162756] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.627147] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('506fca2b-4bdc-418f-be44-db369f7e1332',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.630977] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-506fca2b-4bdc-418f-be44-db369f7e1332 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.630977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.630977] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78a0cd90-a426-4a79-b9b2-dabd1cdaa560 with status ACTIVE [ 1005.630977] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.630977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.630977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.630977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.630977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.630977] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.630977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.630977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.630977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.630977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.630977] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.631573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.631573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.631573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.631573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.631573] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78a0cd90-a426-4a79-b9b2-dabd1cdaa560 is going to be updated. [ 1005.653168] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.653380] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.653454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.653731] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.653829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.653971] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78a0cd90-a426-4a79-b9b2-dabd1cdaa560" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.667375] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.667616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.667693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.668035] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.668305] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.668386] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.668516] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.668675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.668890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.668972] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.669097] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.669535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.669796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.669796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.669927] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.670052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.670162] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.670315] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.670421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.670557] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.670557] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.679819] env[69637]: INFO networking_nsxv3.common.synchronization [None req-c3497a61-cb5b-4e0a-b9ce-3a589c5fa6d9 None None] Enqueued Resource ID: 5371f303-a3a7-4a61-b8df-917d9943f019 with Priority: HIGHEST for action port [ 1005.680098] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5371f303-a3a7-4a61-b8df-917d9943f019 with Priority: HIGHEST for action port [ 1005.680793] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5371f303-a3a7-4a61-b8df-917d9943f019 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.680960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5371f303-a3a7-4a61-b8df-917d9943f019" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.681931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5371f303-a3a7-4a61-b8df-917d9943f019" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.681931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5371f303-a3a7-4a61-b8df-917d9943f019" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.681931] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5371f303-a3a7-4a61-b8df-917d9943f019',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.133833] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('506fca2b-4bdc-418f-be44-db369f7e1332',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.178822] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4dab7827-c31f-472b-b986-30803c457337: rpc.has_security_group_logging(os_id): False [ 1006.186045] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5371f303-a3a7-4a61-b8df-917d9943f019 [ 1006.186045] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.186045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.186045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.186045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.186045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.186045] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5371f303-a3a7-4a61-b8df-917d9943f019 already deleted. [ 1006.186045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5371f303-a3a7-4a61-b8df-917d9943f019" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.198911] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.199066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.199138] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.199351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.199438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.199628] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.201214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.201214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.201214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.201214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.201214] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.201214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.201214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.201214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.201214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.201214] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.201214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.201214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.201725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.201725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.201725] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dab7827-c31f-472b-b986-30803c457337 is going to be created. [ 1006.269241] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.271777] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.271777] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.271777] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.272060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.282122] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: IN_PROGRESS for 2s [ 1006.376698] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d51299a-8425-4d04-b702-fb6eebeef65f in Status: SUCCESS [ 1006.376890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.642022] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.642022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.642022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.642022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.642022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.642022] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 506fca2b-4bdc-418f-be44-db369f7e1332 is going to be created. [ 1006.669434] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.669672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.669672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.669859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.670034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.683890] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 506fca2b-4bdc-418f-be44-db369f7e1332 in Status: UNINITIALIZED for 2s [ 1008.116502] env[69637]: INFO networking_nsxv3.common.synchronization [req-8b9ea469-b1ea-42de-9b52-d4a96ffab6fe req-624b35d7-7840-4535-be93-a990e609b4e6 tempest-AttachVolumeTestJSON-2085947096 tempest-AttachVolumeTestJSON-2085947096-project-member] Enqueued Resource ID: cc38a146-8a93-4507-a45a-aaf042f5e30b with Priority: HIGHEST for action security_group_members [ 1008.117032] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc38a146-8a93-4507-a45a-aaf042f5e30b with Priority: HIGHEST for action security_group_members [ 1008.117342] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc38a146-8a93-4507-a45a-aaf042f5e30b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.117500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.117548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.117760] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.117903] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.117995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.118200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.118362] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.118444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.118986] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc38a146-8a93-4507-a45a-aaf042f5e30b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.292809] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: SUCCESS [ 1008.292809] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.406921] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-193 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.407180] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-193" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.407328] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-193" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.407658] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-193" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.407922] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.408096] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.408232] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.408461] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.408605] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.408813] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.409586] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.409586] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.409712] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.409804] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.409874] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.410021] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.427229] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.427450] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1008.427685] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.427886] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-193" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.428242] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-1a136c80-cb9b-4cae-a49c-f4d6e7c932f5 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.428461] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-1a136c80-cb9b-4cae-a49c-f4d6e7c932f5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.428565] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-1a136c80-cb9b-4cae-a49c-f4d6e7c932f5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.428989] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-1a136c80-cb9b-4cae-a49c-f4d6e7c932f5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.429153] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a136c80-cb9b-4cae-a49c-f4d6e7c932f5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.621483] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.621643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.621773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.622066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.622150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.622391] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.622529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.622529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.622755] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.622755] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.622877] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc38a146-8a93-4507-a45a-aaf042f5e30b already deleted. [ 1008.622930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.693870] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 506fca2b-4bdc-418f-be44-db369f7e1332 in Status: SUCCESS [ 1008.694222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.694657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.694800] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.695107] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.695250] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.695401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.695556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.695662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.695794] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.695877] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('506fca2b-4bdc-418f-be44-db369f7e1332',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.932191] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.932398] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.932902] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.932902] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.933030] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.933205] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 1a136c80-cb9b-4cae-a49c-f4d6e7c932f5 not found, creating... [ 1008.933386] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.933546] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.933663] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.933883] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.934093] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.934444] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.934642] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.934774] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.935019] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.935217] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.935417] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 1a136c80-cb9b-4cae-a49c-f4d6e7c932f5 is going to be created. [ 1008.954514] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.954764] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.954911] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.955237] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.955484] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.956078] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-1a136c80-cb9b-4cae-a49c-f4d6e7c932f5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.197754] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('506fca2b-4bdc-418f-be44-db369f7e1332',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.395699] env[69637]: INFO networking_nsxv3.common.synchronization [req-b67e6a51-c90d-4832-ad5c-923c97cdfcd0 req-ad717a83-4936-4c08-aa0f-c1b8fd737788 tempest-ServersTestFqdnHostnames-1313009998 tempest-ServersTestFqdnHostnames-1313009998-project-member] Enqueued Resource ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 with Priority: HIGHEST for action security_group_members [ 1009.396281] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 with Priority: HIGHEST for action security_group_members [ 1009.397580] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-23bbf0c1-9856-41c8-b206-759ddb9f7695 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.397580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.397580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.397580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.397580] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.397580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.397580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.397580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.397580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.397580] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23bbf0c1-9856-41c8-b206-759ddb9f7695',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.700084] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 506fca2b-4bdc-418f-be44-db369f7e1332: rpc.has_security_group_logging(os_id): False [ 1009.720879] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.721116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.721116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.721321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.721410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.721656] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.721750] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.721841] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.721964] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.722104] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.722166] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 506fca2b-4bdc-418f-be44-db369f7e1332 is going to be created. [ 1009.758025] env[69637]: INFO networking_nsxv3.common.synchronization [req-8b9ea469-b1ea-42de-9b52-d4a96ffab6fe req-e85e04c3-44fe-4e68-a19f-b403634dcfa8 service nova] Enqueued Resource ID: cc38a146-8a93-4507-a45a-aaf042f5e30b with Priority: HIGHEST for action security_group_rules [ 1009.758025] env[69637]: INFO networking_nsxv3.common.synchronization [req-8b9ea469-b1ea-42de-9b52-d4a96ffab6fe req-e85e04c3-44fe-4e68-a19f-b403634dcfa8 service nova] Enqueued Resource ID: cc38a146-8a93-4507-a45a-aaf042f5e30b with Priority: HIGHEST for action security_group_members [ 1009.758025] env[69637]: INFO networking_nsxv3.common.synchronization [req-8b9ea469-b1ea-42de-9b52-d4a96ffab6fe req-e85e04c3-44fe-4e68-a19f-b403634dcfa8 service nova] Enqueued Resource ID: 1a136c80-cb9b-4cae-a49c-f4d6e7c932f5 with Priority: HIGHEST for action port [ 1009.758025] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc38a146-8a93-4507-a45a-aaf042f5e30b with Priority: HIGHEST for action security_group_rules [ 1009.758025] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc38a146-8a93-4507-a45a-aaf042f5e30b with Priority: HIGHEST for action security_group_members [ 1009.758025] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a136c80-cb9b-4cae-a49c-f4d6e7c932f5 with Priority: HIGHEST for action port [ 1009.758025] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc38a146-8a93-4507-a45a-aaf042f5e30b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.758025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.758025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.758025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.758025] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc38a146-8a93-4507-a45a-aaf042f5e30b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.758025] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc38a146-8a93-4507-a45a-aaf042f5e30b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.758669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.758669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.758669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.758757] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.758837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.758907] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.759364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.759477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.759595] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc38a146-8a93-4507-a45a-aaf042f5e30b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.760379] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a136c80-cb9b-4cae-a49c-f4d6e7c932f5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.760506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a136c80-cb9b-4cae-a49c-f4d6e7c932f5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.760596] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a136c80-cb9b-4cae-a49c-f4d6e7c932f5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.760727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a136c80-cb9b-4cae-a49c-f4d6e7c932f5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.760800] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a136c80-cb9b-4cae-a49c-f4d6e7c932f5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.785027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.785027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.785027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.785027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.785027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.796719] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 506fca2b-4bdc-418f-be44-db369f7e1332 in Status: IN_PROGRESS for 2s [ 1009.900368] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.900368] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.900368] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.900368] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.900368] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.900368] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.900885] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.900885] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.900885] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.900885] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.900993] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 is going to be updated. [ 1009.952506] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.952506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.952506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.952506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.952506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.960936] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 in Status: IN_PROGRESS for 2s [ 1010.102223] env[69637]: INFO networking_nsxv3.common.synchronization [req-aa682e19-8078-4a66-8697-1faceddebbd3 req-fcea7b0e-1986-42d8-8df0-3a973cd7b962 tempest-ImagesTestJSON-1924392618 tempest-ImagesTestJSON-1924392618-project-member] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 1010.102223] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGHEST for action security_group_members [ 1010.102733] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.104440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.104440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.104440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.104635] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.104635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.104757] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.104893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.104945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.104998] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.262869] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc38a146-8a93-4507-a45a-aaf042f5e30b taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.263174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.263225] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc38a146-8a93-4507-a45a-aaf042f5e30b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.264090] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a136c80-cb9b-4cae-a49c-f4d6e7c932f5 with status ACTIVE [ 1010.264255] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.264360] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.264421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.264611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.264692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.264850] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.264936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.264992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.265145] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.265216] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.265387] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.265470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.265526] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.265653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.267271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.267271] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a136c80-cb9b-4cae-a49c-f4d6e7c932f5 is going to be updated. [ 1010.290874] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.291114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.291114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.291240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.291386] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.291542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a136c80-cb9b-4cae-a49c-f4d6e7c932f5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.608247] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.608438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.608512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.608723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.608811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.609012] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.609114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.609173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.609328] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.609432] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.609517] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be updated. [ 1010.635849] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.635849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.636056] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.636196] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.636573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.644164] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: IN_PROGRESS for 2s [ 1010.768822] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc38a146-8a93-4507-a45a-aaf042f5e30b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.272101] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.272101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.272101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.272462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.272462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.272462] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc38a146-8a93-4507-a45a-aaf042f5e30b is going to be created. [ 1011.295102] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.295254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.295326] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.295531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.295691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.304578] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc38a146-8a93-4507-a45a-aaf042f5e30b in Status: UNINITIALIZED for 2s [ 1011.807210] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 506fca2b-4bdc-418f-be44-db369f7e1332 in Status: SUCCESS [ 1011.807426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.969257] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 in Status: SUCCESS [ 1011.969482] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23bbf0c1-9856-41c8-b206-759ddb9f7695 deletion is rescheduled due to dependency. [ 1011.969617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23bbf0c1-9856-41c8-b206-759ddb9f7695" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.652843] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 in Status: SUCCESS [ 1012.653116] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 deletion is rescheduled due to dependency. [ 1012.653178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.078682] env[69637]: INFO networking_nsxv3.common.synchronization [req-c6766c39-b017-4380-8f91-957bddd9ddce req-0ea9c01c-c446-47d7-8545-8979b801be4d tempest-ServerRescueTestJSON-1328189417 tempest-ServerRescueTestJSON-1328189417-project-member] Enqueued Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_members [ 1013.079775] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGHEST for action security_group_members [ 1013.079775] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.079931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.079969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.080188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.080337] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.080433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.080495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.080638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.080725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.080817] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.314701] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc38a146-8a93-4507-a45a-aaf042f5e30b in Status: SUCCESS [ 1013.314965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.315278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.315431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.315648] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.315837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.315837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.316031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.316105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.316194] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.316636] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc38a146-8a93-4507-a45a-aaf042f5e30b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.583249] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.583633] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.583633] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.583705] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.584436] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.584436] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.584436] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.584436] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.584436] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.584436] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.584436] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe is going to be updated. [ 1013.610632] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.610806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.610877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.611110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.611256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.618867] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe in Status: IN_PROGRESS for 2s [ 1013.818692] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc38a146-8a93-4507-a45a-aaf042f5e30b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.048925] env[69637]: INFO networking_nsxv3.common.synchronization [req-3f6463bd-548f-41be-b45b-6bf8cae4d734 req-57686ba9-2d0b-4ce7-b3c9-bd593d9b7ccd tempest-ServersAdminTestJSON-567435686 tempest-ServersAdminTestJSON-567435686-project-member] Enqueued Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 1014.049537] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 with Priority: HIGHEST for action security_group_members [ 1014.050257] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff9b407c-6313-458e-a95d-b00d9b8914d1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.050257] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.050355] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.050516] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.050662] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.050868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.050868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.051046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.051132] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.051252] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff9b407c-6313-458e-a95d-b00d9b8914d1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.320970] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc38a146-8a93-4507-a45a-aaf042f5e30b: rpc.has_security_group_logging(os_id): False [ 1014.338821] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.339017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.339064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.339292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.339344] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.339606] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.339712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.339780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.339951] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.340050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.340138] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc38a146-8a93-4507-a45a-aaf042f5e30b is going to be created. [ 1014.397887] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.398087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.398138] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.398367] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.398554] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.408529] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc38a146-8a93-4507-a45a-aaf042f5e30b in Status: IN_PROGRESS for 2s [ 1014.553254] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.553423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.553499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.553727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.554019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.554103] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.554158] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.554205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.554337] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.554414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.554501] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 is going to be updated. [ 1014.585349] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.585500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.585576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.585788] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.585979] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.595300] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: IN_PROGRESS for 2s [ 1015.631117] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe in Status: SUCCESS [ 1015.631117] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe deletion is rescheduled due to dependency. [ 1015.631117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.420547] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc38a146-8a93-4507-a45a-aaf042f5e30b in Status: SUCCESS [ 1016.420547] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.607800] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 in Status: SUCCESS [ 1016.607800] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff9b407c-6313-458e-a95d-b00d9b8914d1 deletion is rescheduled due to dependency. [ 1016.607800] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff9b407c-6313-458e-a95d-b00d9b8914d1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.706623] env[69637]: INFO networking_nsxv3.common.synchronization [req-0919536a-8d55-4e02-919f-8837516eb8ff req-779481c4-6d7a-4167-96a6-203e52a9f4d9 tempest-ServerRescueNegativeTestJSON-1037752610 tempest-ServerRescueNegativeTestJSON-1037752610-project-member] Enqueued Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGHEST for action security_group_members [ 1016.707276] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGHEST for action security_group_members [ 1016.707935] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-26287d78-a077-45b2-9f9c-fbff1368c591 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.707935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.707935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.708808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.708963] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.709116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.709185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.709435] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.709508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.709582] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26287d78-a077-45b2-9f9c-fbff1368c591',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.008667] env[69637]: INFO networking_nsxv3.common.synchronization [req-eee3d5c9-ab95-4bca-ae98-427186cb6c0d req-0edf471e-c073-4925-a93c-064cef3e701f tempest-InstanceActionsTestJSON-276135571 tempest-InstanceActionsTestJSON-276135571-project-member] Enqueued Resource ID: 8d51299a-8425-4d04-b702-fb6eebeef65f with Priority: HIGHEST for action security_group_members [ 1017.009235] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d51299a-8425-4d04-b702-fb6eebeef65f with Priority: HIGHEST for action security_group_members [ 1017.009924] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d51299a-8425-4d04-b702-fb6eebeef65f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.010068] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.010145] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.010588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.010588] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.010588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.010862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.010862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.010862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.010978] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d51299a-8425-4d04-b702-fb6eebeef65f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.155098] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-505 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.155550] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-505" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.155550] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-505" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.155701] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-505" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.155927] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.156218] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.156388] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.156608] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.156757] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.156970] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1017.157087] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1017.157198] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1017.157506] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1017.157506] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1017.157506] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1017.157669] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.175928] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.176138] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1017.176405] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.180090] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-505" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.180090] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-2d87c8f9-1e98-42cc-9d09-e4d0b200fb23 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.180090] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-2d87c8f9-1e98-42cc-9d09-e4d0b200fb23" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.180090] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-2d87c8f9-1e98-42cc-9d09-e4d0b200fb23" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.180090] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-2d87c8f9-1e98-42cc-9d09-e4d0b200fb23" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.180090] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d87c8f9-1e98-42cc-9d09-e4d0b200fb23',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.211462] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.213301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.213301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.213301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.213301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.213301] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.213301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.213301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.213301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.213301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.213301] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26287d78-a077-45b2-9f9c-fbff1368c591 already deleted. [ 1017.213301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.515742] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.515742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.515742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.515742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.515742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.515742] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.515742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.515742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.515742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.515742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.515742] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d51299a-8425-4d04-b702-fb6eebeef65f is going to be updated. [ 1017.550359] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.550359] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.550359] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.550359] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.550359] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.559612] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d51299a-8425-4d04-b702-fb6eebeef65f in Status: IN_PROGRESS for 2s [ 1017.686216] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.686216] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.686216] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.686216] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.686693] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.686693] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 2d87c8f9-1e98-42cc-9d09-e4d0b200fb23 not found, creating... [ 1017.686991] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.686991] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.687143] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.687308] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.687459] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.687761] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.687982] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.688050] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.688657] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.688657] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.688657] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 2d87c8f9-1e98-42cc-9d09-e4d0b200fb23 is going to be created. [ 1017.707014] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.707373] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.707373] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.707595] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.707831] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.708085] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-2d87c8f9-1e98-42cc-9d09-e4d0b200fb23" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.512550] env[69637]: INFO networking_nsxv3.common.synchronization [req-0919536a-8d55-4e02-919f-8837516eb8ff req-9bb8ae1e-b8db-4fc2-8f42-a27568bf4216 service nova] Enqueued Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGHEST for action security_group_rules [ 1018.512739] env[69637]: INFO networking_nsxv3.common.synchronization [req-0919536a-8d55-4e02-919f-8837516eb8ff req-9bb8ae1e-b8db-4fc2-8f42-a27568bf4216 service nova] Enqueued Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGHEST for action security_group_members [ 1018.512882] env[69637]: INFO networking_nsxv3.common.synchronization [req-0919536a-8d55-4e02-919f-8837516eb8ff req-9bb8ae1e-b8db-4fc2-8f42-a27568bf4216 service nova] Enqueued Resource ID: 2d87c8f9-1e98-42cc-9d09-e4d0b200fb23 with Priority: HIGHEST for action port [ 1018.513390] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGHEST for action security_group_rules [ 1018.513522] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGHEST for action security_group_members [ 1018.513620] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d87c8f9-1e98-42cc-9d09-e4d0b200fb23 with Priority: HIGHEST for action port [ 1018.513884] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26287d78-a077-45b2-9f9c-fbff1368c591 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.514013] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.514121] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.514304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.514384] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26287d78-a077-45b2-9f9c-fbff1368c591',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.515321] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-26287d78-a077-45b2-9f9c-fbff1368c591 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.515431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.515501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.517024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.517024] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.517024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.517024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.517024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.517024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.517024] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26287d78-a077-45b2-9f9c-fbff1368c591',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.517024] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d87c8f9-1e98-42cc-9d09-e4d0b200fb23 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.517484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d87c8f9-1e98-42cc-9d09-e4d0b200fb23" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.517484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d87c8f9-1e98-42cc-9d09-e4d0b200fb23" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.517484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d87c8f9-1e98-42cc-9d09-e4d0b200fb23" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.517484] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d87c8f9-1e98-42cc-9d09-e4d0b200fb23',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.019064] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-26287d78-a077-45b2-9f9c-fbff1368c591 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.019471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.020679] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26287d78-a077-45b2-9f9c-fbff1368c591',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.021826] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d87c8f9-1e98-42cc-9d09-e4d0b200fb23 with status ACTIVE [ 1019.022111] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.022277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.022379] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.022661] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.022792] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.023059] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.023205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.023305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.023535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.023647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.023921] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.024888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.025024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.025377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.025621] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.025770] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d87c8f9-1e98-42cc-9d09-e4d0b200fb23 is going to be updated. [ 1019.052814] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.052814] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.052814] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.052814] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.053736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.053736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d87c8f9-1e98-42cc-9d09-e4d0b200fb23" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.528256] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26287d78-a077-45b2-9f9c-fbff1368c591',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.569199] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d51299a-8425-4d04-b702-fb6eebeef65f in Status: SUCCESS [ 1019.569382] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d51299a-8425-4d04-b702-fb6eebeef65f deletion is rescheduled due to dependency. [ 1019.569742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d51299a-8425-4d04-b702-fb6eebeef65f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.031360] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.031712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.031712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.031794] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.031862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.031957] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26287d78-a077-45b2-9f9c-fbff1368c591 is going to be created. [ 1020.059502] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.059692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.059775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.059963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.060136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.068757] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26287d78-a077-45b2-9f9c-fbff1368c591 in Status: UNINITIALIZED for 2s [ 1022.078976] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26287d78-a077-45b2-9f9c-fbff1368c591 in Status: SUCCESS [ 1022.079345] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.079401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.079627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.079794] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.079907] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.079968] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.080142] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.080221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.080305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.080395] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26287d78-a077-45b2-9f9c-fbff1368c591',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.582728] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26287d78-a077-45b2-9f9c-fbff1368c591',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.085508] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26287d78-a077-45b2-9f9c-fbff1368c591: rpc.has_security_group_logging(os_id): False [ 1023.102640] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.102815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.102859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.103181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.103270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.103568] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.103680] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.103748] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.103901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.103984] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.104078] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26287d78-a077-45b2-9f9c-fbff1368c591 is going to be created. [ 1023.160765] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.160910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.160982] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.161215] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.161400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.172957] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26287d78-a077-45b2-9f9c-fbff1368c591 in Status: IN_PROGRESS for 2s [ 1023.514970] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1023.514970] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1023.700593] env[69637]: INFO networking_nsxv3.common.synchronization [req-3525eaf4-6040-49eb-915a-add4e207dea2 req-c64679a5-98e7-4b24-bc28-153c3a3b84a2 tempest-ServersWithSpecificFlavorTestJSON-315105085 tempest-ServersWithSpecificFlavorTestJSON-315105085-project-member] Enqueued Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_members [ 1023.705103] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_members [ 1023.705103] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-108f5aaf-b223-4e3b-b27d-aa7c7e251598 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.705214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.705283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.705483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.705634] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.705730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.705829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.707784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.707784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.707784] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.998138] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-480 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.998138] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.998335] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.998981] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.999150] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.999342] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.999513] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.999775] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.999932] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.000160] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.000279] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.000393] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.000504] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.000618] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.000728] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.000943] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.019153] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.020044] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1024.020044] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.020044] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-480" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.020282] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-21144f3d-a4cf-4c52-bd2d-78bfd4f8e577 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.020282] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-21144f3d-a4cf-4c52-bd2d-78bfd4f8e577" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.020481] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-21144f3d-a4cf-4c52-bd2d-78bfd4f8e577" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.020691] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-21144f3d-a4cf-4c52-bd2d-78bfd4f8e577" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.020846] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21144f3d-a4cf-4c52-bd2d-78bfd4f8e577',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.209119] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.209407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.209407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.209480] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.209515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.209879] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.210045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.210118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.210297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.210386] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.210486] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 is going to be updated. [ 1024.253692] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.253853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.253938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.254220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.254366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.264589] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 in Status: IN_PROGRESS for 2s [ 1024.522971] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.523248] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.523373] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.523673] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.523835] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.524011] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 21144f3d-a4cf-4c52-bd2d-78bfd4f8e577 not found, creating... [ 1024.524301] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.524474] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.524605] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.524829] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.524985] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.525315] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.525480] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.525615] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.525944] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.526123] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.526282] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 21144f3d-a4cf-4c52-bd2d-78bfd4f8e577 is going to be created. [ 1024.545208] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.545649] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.545815] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.546070] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.546420] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.546797] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-21144f3d-a4cf-4c52-bd2d-78bfd4f8e577" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.186938] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26287d78-a077-45b2-9f9c-fbff1368c591 in Status: SUCCESS [ 1025.187192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.234570] env[69637]: INFO networking_nsxv3.common.synchronization [req-3525eaf4-6040-49eb-915a-add4e207dea2 req-ea8d1986-d697-4f30-90b0-a54ed8294bd9 service nova] Enqueued Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_rules [ 1025.234570] env[69637]: INFO networking_nsxv3.common.synchronization [req-3525eaf4-6040-49eb-915a-add4e207dea2 req-ea8d1986-d697-4f30-90b0-a54ed8294bd9 service nova] Enqueued Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_members [ 1025.234823] env[69637]: INFO networking_nsxv3.common.synchronization [req-3525eaf4-6040-49eb-915a-add4e207dea2 req-ea8d1986-d697-4f30-90b0-a54ed8294bd9 service nova] Enqueued Resource ID: 21144f3d-a4cf-4c52-bd2d-78bfd4f8e577 with Priority: HIGHEST for action port [ 1025.234861] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_rules [ 1025.235011] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_members [ 1025.235128] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21144f3d-a4cf-4c52-bd2d-78bfd4f8e577 with Priority: HIGHEST for action port [ 1025.235877] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.235969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.235969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.236236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.236323] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.237650] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-108f5aaf-b223-4e3b-b27d-aa7c7e251598 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.238498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.238498] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-21144f3d-a4cf-4c52-bd2d-78bfd4f8e577 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.238498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21144f3d-a4cf-4c52-bd2d-78bfd4f8e577" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.238498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21144f3d-a4cf-4c52-bd2d-78bfd4f8e577" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.238846] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21144f3d-a4cf-4c52-bd2d-78bfd4f8e577" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.238846] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21144f3d-a4cf-4c52-bd2d-78bfd4f8e577',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.741056] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-108f5aaf-b223-4e3b-b27d-aa7c7e251598 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.741266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.741398] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21144f3d-a4cf-4c52-bd2d-78bfd4f8e577 with status ACTIVE [ 1025.741551] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.741661] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.741723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.741945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.742074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.742211] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.742374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.742374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.742518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.742599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.742918] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.742918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.742918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.743076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.743157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.743230] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21144f3d-a4cf-4c52-bd2d-78bfd4f8e577 is going to be updated. [ 1025.765670] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.765670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.765670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.765867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.765982] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.766154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21144f3d-a4cf-4c52-bd2d-78bfd4f8e577" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.275127] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 in Status: SUCCESS [ 1026.275127] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 deletion is rescheduled due to dependency. [ 1026.275127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.275538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.275538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.275768] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.275916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.276165] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.276248] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.276307] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.276440] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.778274] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.280756] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.783878] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.784045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.784121] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.784339] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.784453] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.784557] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 is going to be updated. [ 1027.816615] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.816741] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.816780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.817019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.817172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.825711] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 in Status: IN_PROGRESS for 2s [ 1029.836488] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 in Status: SUCCESS [ 1029.836817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.836931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.837178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.837378] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.837500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.837572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.837710] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.837796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.838062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.838062] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.236081] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1030.236178] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1030.340511] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.344862] env[69637]: INFO networking_nsxv3.common.synchronization [req-57531ac2-ec3e-4aa6-9b9c-18ce4c4ed938 req-3661d985-9415-43bf-9b22-8183063f6074 tempest-FloatingIPsAssociationNegativeTestJSON-543408417 tempest-FloatingIPsAssociationNegativeTestJSON-543408417-project-member] Enqueued Resource ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a with Priority: HIGHEST for action security_group_members [ 1030.345121] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a with Priority: HIGHEST for action security_group_members [ 1030.345643] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-726820b1-ac2b-45a1-aaf6-d2c41e47022a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.345773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.345851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.346556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.346556] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.346556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.346556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.346556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.346878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.346878] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('726820b1-ac2b-45a1-aaf6-d2c41e47022a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.643243] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-767 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.643488] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-767" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.643651] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-767" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.643947] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-767" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.644254] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.644461] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.644611] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.644841] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.644999] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.645577] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.645577] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.645577] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.645577] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.645760] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.645760] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.645866] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.663674] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.663847] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1030.663938] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.664127] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-767" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.664407] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-f44f014b-52a6-4ef8-89a4-2ce36000e942 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.664570] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-f44f014b-52a6-4ef8-89a4-2ce36000e942" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.664692] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-f44f014b-52a6-4ef8-89a4-2ce36000e942" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.665009] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-f44f014b-52a6-4ef8-89a4-2ce36000e942" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.665159] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f44f014b-52a6-4ef8-89a4-2ce36000e942',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.843640] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 108f5aaf-b223-4e3b-b27d-aa7c7e251598: rpc.has_security_group_logging(os_id): False [ 1030.851460] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.851634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.851821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.851935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.852038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.852226] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.852342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.852403] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.852550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.852639] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.852723] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a already deleted. [ 1030.852805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.862135] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.862135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.862135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.862261] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.862293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.864627] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.864627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.864627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.864627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.864627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.864627] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 is going to be updated. [ 1030.917545] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.917545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.917545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.917545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.917545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.929635] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 in Status: IN_PROGRESS for 2s [ 1031.167755] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.168400] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.168400] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.168400] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.168544] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.168681] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port f44f014b-52a6-4ef8-89a4-2ce36000e942 not found, creating... [ 1031.169032] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.169201] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.169322] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.169573] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.169706] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.170031] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.170197] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.170323] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.170545] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.170697] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.170848] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: f44f014b-52a6-4ef8-89a4-2ce36000e942 is going to be created. [ 1031.190157] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.190385] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.190517] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.190791] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.191052] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.191356] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-f44f014b-52a6-4ef8-89a4-2ce36000e942" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.882212] env[69637]: INFO networking_nsxv3.common.synchronization [req-57531ac2-ec3e-4aa6-9b9c-18ce4c4ed938 req-00effc11-afae-46fd-8957-bb1ab545731a service nova] Enqueued Resource ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a with Priority: HIGHEST for action security_group_rules [ 1031.882512] env[69637]: INFO networking_nsxv3.common.synchronization [req-57531ac2-ec3e-4aa6-9b9c-18ce4c4ed938 req-00effc11-afae-46fd-8957-bb1ab545731a service nova] Enqueued Resource ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a with Priority: HIGHEST for action security_group_members [ 1031.882670] env[69637]: INFO networking_nsxv3.common.synchronization [req-57531ac2-ec3e-4aa6-9b9c-18ce4c4ed938 req-00effc11-afae-46fd-8957-bb1ab545731a service nova] Enqueued Resource ID: f44f014b-52a6-4ef8-89a4-2ce36000e942 with Priority: HIGHEST for action port [ 1031.882748] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a with Priority: HIGHEST for action security_group_rules [ 1031.882872] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a with Priority: HIGHEST for action security_group_members [ 1031.882968] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44f014b-52a6-4ef8-89a4-2ce36000e942 with Priority: HIGHEST for action port [ 1031.883515] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-726820b1-ac2b-45a1-aaf6-d2c41e47022a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.883637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.883790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.883940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.884116] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('726820b1-ac2b-45a1-aaf6-d2c41e47022a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.885506] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-726820b1-ac2b-45a1-aaf6-d2c41e47022a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.885634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.885705] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.885955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.886166] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.886269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.886334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.886484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.886568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.886659] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('726820b1-ac2b-45a1-aaf6-d2c41e47022a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.887415] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-f44f014b-52a6-4ef8-89a4-2ce36000e942 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.887521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f44f014b-52a6-4ef8-89a4-2ce36000e942" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.887593] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f44f014b-52a6-4ef8-89a4-2ce36000e942" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.887731] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f44f014b-52a6-4ef8-89a4-2ce36000e942" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.887819] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f44f014b-52a6-4ef8-89a4-2ce36000e942',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.391608] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-726820b1-ac2b-45a1-aaf6-d2c41e47022a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.391775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.392088] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f44f014b-52a6-4ef8-89a4-2ce36000e942 with status ACTIVE [ 1032.392334] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.392482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.392550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.393288] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.393477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.393645] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.393786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.393934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.394221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.394469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.394687] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.394770] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.394879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.395381] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.395488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.395619] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f44f014b-52a6-4ef8-89a4-2ce36000e942 is going to be updated. [ 1032.397751] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('726820b1-ac2b-45a1-aaf6-d2c41e47022a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.416751] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.416906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.417064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.417205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.417346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.417691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f44f014b-52a6-4ef8-89a4-2ce36000e942" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.839309] env[69637]: INFO networking_nsxv3.common.synchronization [req-09f9c9b3-149a-467c-b73f-9ff2aee8fc1e req-9b92accf-eef6-408e-960a-d4ce36eaf5c0 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_members [ 1032.839861] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_members [ 1032.840188] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e078c82-40fd-4661-9911-198585d187a7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.840310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.840378] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.840577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.840725] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.840818] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.840879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.841134] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.841241] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.841338] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.899678] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('726820b1-ac2b-45a1-aaf6-d2c41e47022a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.941125] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 in Status: SUCCESS [ 1032.941370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.249603] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-149 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.249603] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.249603] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.249603] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.249603] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.249603] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.250127] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.250127] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.250127] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.250289] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1033.250371] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1033.250481] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1033.250589] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1033.250700] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1033.250809] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1033.250937] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1033.269053] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1033.269328] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1033.269411] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1033.269628] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.269957] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-39637170-7884-4c45-8e42-5448aa6e04dd taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.270135] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-39637170-7884-4c45-8e42-5448aa6e04dd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.270253] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-39637170-7884-4c45-8e42-5448aa6e04dd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.270566] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-39637170-7884-4c45-8e42-5448aa6e04dd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.271332] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39637170-7884-4c45-8e42-5448aa6e04dd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.343015] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.407081] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.407081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.407081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.407081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.407081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.407081] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a is going to be created. [ 1033.426158] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.427736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.427736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.427736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.427736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.436855] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a in Status: UNINITIALIZED for 2s [ 1033.772932] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.773249] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.773455] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.773673] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.773826] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.774040] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 39637170-7884-4c45-8e42-5448aa6e04dd not found, creating... [ 1033.774379] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.774653] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.774861] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.775223] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.775474] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.775820] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.776097] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.776308] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.776561] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.776737] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.776958] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 39637170-7884-4c45-8e42-5448aa6e04dd is going to be created. [ 1033.795233] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.795445] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.795570] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.795836] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.796081] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.796317] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-39637170-7884-4c45-8e42-5448aa6e04dd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.845960] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.348526] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.348856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.348856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.349070] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.349212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.349337] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e078c82-40fd-4661-9911-198585d187a7 is going to be updated. [ 1034.380362] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.380520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.380567] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.380768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.380911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.391241] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e078c82-40fd-4661-9911-198585d187a7 in Status: IN_PROGRESS for 2s [ 1034.703188] env[69637]: INFO networking_nsxv3.common.synchronization [req-09f9c9b3-149a-467c-b73f-9ff2aee8fc1e req-ecdc9df3-16ec-44e7-b2a4-0ce97f1ae66b service nova] Enqueued Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_rules [ 1034.703188] env[69637]: INFO networking_nsxv3.common.synchronization [req-09f9c9b3-149a-467c-b73f-9ff2aee8fc1e req-ecdc9df3-16ec-44e7-b2a4-0ce97f1ae66b service nova] Enqueued Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_members [ 1034.703188] env[69637]: INFO networking_nsxv3.common.synchronization [req-09f9c9b3-149a-467c-b73f-9ff2aee8fc1e req-ecdc9df3-16ec-44e7-b2a4-0ce97f1ae66b service nova] Enqueued Resource ID: 39637170-7884-4c45-8e42-5448aa6e04dd with Priority: HIGHEST for action port [ 1034.703188] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_rules [ 1034.703188] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_members [ 1034.703188] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39637170-7884-4c45-8e42-5448aa6e04dd with Priority: HIGHEST for action port [ 1034.704765] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e078c82-40fd-4661-9911-198585d187a7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.704958] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.705054] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.705301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.705407] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.706621] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e078c82-40fd-4661-9911-198585d187a7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.706743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.707286] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-39637170-7884-4c45-8e42-5448aa6e04dd taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.707441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39637170-7884-4c45-8e42-5448aa6e04dd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.707530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39637170-7884-4c45-8e42-5448aa6e04dd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.707736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39637170-7884-4c45-8e42-5448aa6e04dd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.707834] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39637170-7884-4c45-8e42-5448aa6e04dd',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.889328] env[69637]: INFO networking_nsxv3.common.synchronization [None req-af9457eb-ffa6-469d-bd62-3b73b023c325 tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f with Priority: HIGHEST for action security_group_rules [ 1034.890075] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f with Priority: HIGHEST for action security_group_rules [ 1034.890248] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.890325] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.890394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.890803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.890803] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.962472] env[69637]: INFO networking_nsxv3.common.synchronization [None req-22468426-b2ce-4c71-8e59-d78c4c768cce tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f with Priority: HIGHEST for action security_group_rules [ 1034.963330] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f with Priority: HIGHEST for action security_group_rules [ 1034.963675] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.963810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.209858] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e078c82-40fd-4661-9911-198585d187a7 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.209985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.211453] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39637170-7884-4c45-8e42-5448aa6e04dd with status ACTIVE [ 1035.211690] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.211768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.211845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.212059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.212153] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.212332] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.212433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.212494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.212660] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.212738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.212921] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.213042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.213111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.213254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.213331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.213414] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39637170-7884-4c45-8e42-5448aa6e04dd is going to be updated. [ 1035.234529] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.234671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.234743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.234951] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.235424] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.235424] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39637170-7884-4c45-8e42-5448aa6e04dd" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.419515] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.419515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.419515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.419515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.419515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.419515] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f already deleted. [ 1035.419515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.419515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.419515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.419515] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.451024] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a in Status: SUCCESS [ 1035.451024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.451024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.451024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.451024] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.451024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.451024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.451024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.451024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.451024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.451024] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('726820b1-ac2b-45a1-aaf6-d2c41e47022a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.943568] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.943713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.943784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.943999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.944102] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.944203] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f already deleted. [ 1035.944285] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.955905] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-726820b1-ac2b-45a1-aaf6-d2c41e47022a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.955998] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.956079] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.956283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.956442] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.956548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.956621] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.956800] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.956845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.956939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.957162] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-726820b1-ac2b-45a1-aaf6-d2c41e47022a taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.957271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.957324] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.957467] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.957603] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.957687] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.957749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.957880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.957962] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.958052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.958142] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('726820b1-ac2b-45a1-aaf6-d2c41e47022a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.400918] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e078c82-40fd-4661-9911-198585d187a7 in Status: SUCCESS [ 1036.401246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.401471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.401778] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.402164] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.402264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.402320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.402518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.402614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.402768] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.463504] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 726820b1-ac2b-45a1-aaf6-d2c41e47022a: rpc.has_security_group_logging(os_id): False [ 1036.484115] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.484115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.484115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.484115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.484115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.484115] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.484115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.484115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.484115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.484115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.484115] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.484115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.484115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.484115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.484115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.484601] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.484601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.484601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.484601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.484601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.484601] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a is going to be created. [ 1036.543873] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.544034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.544034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.544334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.545672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.554352] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a in Status: IN_PROGRESS for 2s [ 1036.908042] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.412163] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.918329] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.918329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.918329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.918329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.918329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.918329] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e078c82-40fd-4661-9911-198585d187a7 is going to be updated. [ 1037.955510] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.955510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.955510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.955510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.955510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.971654] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e078c82-40fd-4661-9911-198585d187a7 in Status: IN_PROGRESS for 2s [ 1038.569874] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a in Status: SUCCESS [ 1038.569874] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.794163] env[69637]: INFO networking_nsxv3.common.synchronization [req-4047abdd-d7a9-410a-89bd-2516024e1d82 req-7407d9ce-b66e-4194-8e16-78ad6ea5062c tempest-ServersNegativeTestJSON-962136673 tempest-ServersNegativeTestJSON-962136673-project-member] Enqueued Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_members [ 1038.794778] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_members [ 1038.795384] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.795498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.795498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.795700] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.795863] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.795964] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.796558] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.796558] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.796558] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.796558] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.300207] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.363136] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-576 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.363341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.363504] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.363777] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.364050] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.364248] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.364375] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.364596] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.364744] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.364959] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.365079] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.365209] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.365415] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.365561] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.365700] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.365837] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.385898] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.386224] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1039.386423] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.386632] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.386969] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-f330d273-aff7-4fdf-b98f-0f7abfcb073c taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.387220] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-f330d273-aff7-4fdf-b98f-0f7abfcb073c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.387517] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-f330d273-aff7-4fdf-b98f-0f7abfcb073c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.387816] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-f330d273-aff7-4fdf-b98f-0f7abfcb073c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.388014] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f330d273-aff7-4fdf-b98f-0f7abfcb073c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.804909] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.894397] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.894975] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.896947] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.896947] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.896947] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.896947] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port f330d273-aff7-4fdf-b98f-0f7abfcb073c not found, creating... [ 1039.896947] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.896947] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.897335] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.897658] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.897939] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.898465] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.898784] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.899022] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.899436] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.899707] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.900055] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: f330d273-aff7-4fdf-b98f-0f7abfcb073c is going to be created. [ 1039.922881] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.922881] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.922881] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.922881] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.923230] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.923350] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-f330d273-aff7-4fdf-b98f-0f7abfcb073c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.988022] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e078c82-40fd-4661-9911-198585d187a7 in Status: SUCCESS [ 1039.988022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.988022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.988022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.988022] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.988022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.988022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.988022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.988022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.988022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.988022] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.306173] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.306580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.306580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.306695] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.306695] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.306786] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dab7827-c31f-472b-b986-30803c457337 is going to be updated. [ 1040.334757] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.336269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.336469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.336663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.336823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.346277] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: IN_PROGRESS for 2s [ 1040.487712] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.991656] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e078c82-40fd-4661-9911-198585d187a7: rpc.has_security_group_logging(os_id): False [ 1040.996367] env[69637]: INFO networking_nsxv3.common.synchronization [None req-2f4bd13e-f545-486e-80f9-5be9ac9e4625 None None] Enqueued Resource ID: 6f6c1b02-50b9-4149-a663-b8946b84d1f8 with Priority: HIGHEST for action port [ 1040.996608] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6c1b02-50b9-4149-a663-b8946b84d1f8 with Priority: HIGHEST for action port [ 1040.997597] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f6c1b02-50b9-4149-a663-b8946b84d1f8 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.997758] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f6c1b02-50b9-4149-a663-b8946b84d1f8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.997830] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f6c1b02-50b9-4149-a663-b8946b84d1f8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.998315] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f6c1b02-50b9-4149-a663-b8946b84d1f8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.998408] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f6c1b02-50b9-4149-a663-b8946b84d1f8',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.009996] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.010187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.010269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.010476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.010569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.010813] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.010912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.010977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.011143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.011222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.011310] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e078c82-40fd-4661-9911-198585d187a7 is going to be updated. [ 1041.055399] env[69637]: INFO networking_nsxv3.common.synchronization [req-4047abdd-d7a9-410a-89bd-2516024e1d82 req-ef2d6e8d-f707-4a86-b7d8-1640990a4088 service nova] Enqueued Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_rules [ 1041.055574] env[69637]: INFO networking_nsxv3.common.synchronization [req-4047abdd-d7a9-410a-89bd-2516024e1d82 req-ef2d6e8d-f707-4a86-b7d8-1640990a4088 service nova] Enqueued Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_members [ 1041.055718] env[69637]: INFO networking_nsxv3.common.synchronization [req-4047abdd-d7a9-410a-89bd-2516024e1d82 req-ef2d6e8d-f707-4a86-b7d8-1640990a4088 service nova] Enqueued Resource ID: f330d273-aff7-4fdf-b98f-0f7abfcb073c with Priority: HIGHEST for action port [ 1041.055941] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_rules [ 1041.056082] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_members [ 1041.056183] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f330d273-aff7-4fdf-b98f-0f7abfcb073c with Priority: HIGHEST for action port [ 1041.056693] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.056815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.056883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.057300] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.057530] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.061694] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.061694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.061694] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-f330d273-aff7-4fdf-b98f-0f7abfcb073c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.061694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f330d273-aff7-4fdf-b98f-0f7abfcb073c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.061694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f330d273-aff7-4fdf-b98f-0f7abfcb073c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.061694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f330d273-aff7-4fdf-b98f-0f7abfcb073c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.061694] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f330d273-aff7-4fdf-b98f-0f7abfcb073c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.066385] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.067142] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.067264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.067438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.067586] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.082336] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e078c82-40fd-4661-9911-198585d187a7 in Status: IN_PROGRESS for 2s [ 1041.502033] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f6c1b02-50b9-4149-a663-b8946b84d1f8 [ 1041.502033] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.502033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.502033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.506203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.506203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.506203] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f6c1b02-50b9-4149-a663-b8946b84d1f8 already deleted. [ 1041.506203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f6c1b02-50b9-4149-a663-b8946b84d1f8" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.562087] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f330d273-aff7-4fdf-b98f-0f7abfcb073c with status ACTIVE [ 1041.562318] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.562459] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.562527] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.562743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.562836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.563033] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.563139] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.563195] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.563348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.563425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.563613] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.563705] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.563766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.564333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.564333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.568110] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f330d273-aff7-4fdf-b98f-0f7abfcb073c is going to be updated. [ 1041.568110] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.568110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.586581] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.586581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.586581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.586581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.586581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.586993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f330d273-aff7-4fdf-b98f-0f7abfcb073c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.903596] env[69637]: INFO networking_nsxv3.common.synchronization [None req-54122dcf-7f35-4181-a032-68e993eb75c3 tempest-ServerActionsTestOtherB-2018875684 tempest-ServerActionsTestOtherB-2018875684-project-member] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_rules [ 1041.904049] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_rules [ 1041.904442] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.904560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.904625] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.904869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.904945] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.279998] env[69637]: INFO networking_nsxv3.common.synchronization [None req-ced29e80-b274-4aed-9ce4-efcc82b496a0 None None] Enqueued Resource ID: fa24901e-1655-4899-a8d4-b066c580562b with Priority: HIGHEST for action port [ 1042.279998] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa24901e-1655-4899-a8d4-b066c580562b with Priority: HIGHEST for action port [ 1042.279998] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa24901e-1655-4899-a8d4-b066c580562b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.279998] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa24901e-1655-4899-a8d4-b066c580562b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.279998] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa24901e-1655-4899-a8d4-b066c580562b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.282233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa24901e-1655-4899-a8d4-b066c580562b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.282233] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa24901e-1655-4899-a8d4-b066c580562b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.359236] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: SUCCESS [ 1042.360816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.360816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.360816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.360816] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.360816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.360816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.361257] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.361257] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.361317] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.390544] env[69637]: INFO networking_nsxv3.common.synchronization [None req-1b6ab8ed-54ac-4cf2-8fd6-e10de350726b tempest-ServerActionsTestOtherB-2018875684 tempest-ServerActionsTestOtherB-2018875684-project-member] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_rules [ 1042.391117] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_rules [ 1042.392690] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.392690] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.425450] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.426336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.426336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.426336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.426336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.426336] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 already deleted. [ 1042.426336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.426686] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.426863] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.426953] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.786058] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa24901e-1655-4899-a8d4-b066c580562b [ 1042.786058] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.786058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.786058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.786058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.786058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.786058] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa24901e-1655-4899-a8d4-b066c580562b already deleted. [ 1042.786058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa24901e-1655-4899-a8d4-b066c580562b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.864615] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.948393] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.948536] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.948606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.948822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.948916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.949029] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 already deleted. [ 1042.949124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.097139] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e078c82-40fd-4661-9911-198585d187a7 in Status: SUCCESS [ 1043.098399] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.367128] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.870019] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.870318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.870318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.870494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.870588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.870690] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dab7827-c31f-472b-b986-30803c457337 is going to be updated. [ 1043.898663] env[69637]: INFO networking_nsxv3.common.synchronization [None req-9adec543-f549-4a3f-b152-ae09691a37a3 None None] Enqueued Resource ID: 9e1bd63a-aabe-408b-b41d-92b6b9caa609 with Priority: HIGHEST for action port [ 1043.901845] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.901845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.901845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.901845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.901845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.903326] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e1bd63a-aabe-408b-b41d-92b6b9caa609 with Priority: HIGHEST for action port [ 1043.904264] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e1bd63a-aabe-408b-b41d-92b6b9caa609 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.904375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e1bd63a-aabe-408b-b41d-92b6b9caa609" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.904435] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e1bd63a-aabe-408b-b41d-92b6b9caa609" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.905039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e1bd63a-aabe-408b-b41d-92b6b9caa609" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.905039] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e1bd63a-aabe-408b-b41d-92b6b9caa609',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.912376] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: IN_PROGRESS for 2s [ 1044.407024] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e1bd63a-aabe-408b-b41d-92b6b9caa609 [ 1044.407440] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.407535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.407535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.407745] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.407835] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.407931] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e1bd63a-aabe-408b-b41d-92b6b9caa609 already deleted. [ 1044.408016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e1bd63a-aabe-408b-b41d-92b6b9caa609" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.642544] env[69637]: INFO networking_nsxv3.common.synchronization [None req-5aef0a7e-a40b-403c-a4e9-24336a6d1c05 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 1045.642906] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 1045.643259] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.643461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.643461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.643632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.643773] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.643869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.643931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.644086] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.644171] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.644266] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.680952] env[69637]: INFO networking_nsxv3.common.synchronization [None req-9cf021ee-0ab6-47c7-9bd5-b19a5c61bdaf None None] Enqueued Resource ID: b25d0ee3-3895-4b18-9a10-9b200e3add65 with Priority: HIGHEST for action port [ 1045.681215] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b25d0ee3-3895-4b18-9a10-9b200e3add65 with Priority: HIGHEST for action port [ 1045.681725] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-b25d0ee3-3895-4b18-9a10-9b200e3add65 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.681849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b25d0ee3-3895-4b18-9a10-9b200e3add65" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.681925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b25d0ee3-3895-4b18-9a10-9b200e3add65" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.682275] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b25d0ee3-3895-4b18-9a10-9b200e3add65" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.682275] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b25d0ee3-3895-4b18-9a10-9b200e3add65',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.890356] env[69637]: INFO networking_nsxv3.common.synchronization [req-bb25ac16-26e2-43cb-b020-55a076417ec2 req-366b7b6e-6322-4b52-ab5b-858f6e5ed3c4 tempest-ServerDiagnosticsTest-1230345668 tempest-ServerDiagnosticsTest-1230345668-project-member] Enqueued Resource ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 with Priority: HIGHEST for action security_group_members [ 1045.890890] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 with Priority: HIGHEST for action security_group_members [ 1045.891210] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.891356] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.891569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.891826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.891990] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.892222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.892222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.892314] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.892385] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.892480] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d92d6b5-2ff4-49ef-8464-4c34d82dd192',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.924226] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: SUCCESS [ 1045.924482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.926575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.926811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.927035] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.927155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.927344] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.927401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.927489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.927520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.927708] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.146969] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.147159] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.147262] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.147476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.147586] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.147787] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.147883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.147964] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.148146] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.148244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.148357] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be updated. [ 1046.172707] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.172871] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.172998] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.173219] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.173351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.181446] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 1046.184933] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b25d0ee3-3895-4b18-9a10-9b200e3add65 [ 1046.185261] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.185357] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.185422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.185675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.185801] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.185887] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b25d0ee3-3895-4b18-9a10-9b200e3add65 already deleted. [ 1046.185989] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b25d0ee3-3895-4b18-9a10-9b200e3add65" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.394953] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.395707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.395707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.395707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.395707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.395955] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.396382] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.396382] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.396382] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.396546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.396590] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 already deleted. [ 1046.396704] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.430128] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.430320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.430391] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.430631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.430854] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.430974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.431069] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.431269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.431370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.431487] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.431644] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.431761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.431826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.431971] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.432178] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.432302] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.432365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.432533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.432629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.432710] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.432831] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.827219] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.827805] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.828062] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.828439] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.828810] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.829112] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.829354] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.833020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.833020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.833020] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.833020] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1046.833020] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1046.833020] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1046.833020] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.833020] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1046.833020] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1046.851064] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1046.851244] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1046.851384] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1046.851613] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-994" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.851954] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-9cd2f648-de18-4069-aa22-1a8a770b5cb7 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.852139] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-9cd2f648-de18-4069-aa22-1a8a770b5cb7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.852278] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-9cd2f648-de18-4069-aa22-1a8a770b5cb7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.852620] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-9cd2f648-de18-4069-aa22-1a8a770b5cb7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.852765] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cd2f648-de18-4069-aa22-1a8a770b5cb7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.938115] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4dab7827-c31f-472b-b986-30803c457337: rpc.has_security_group_logging(os_id): False [ 1046.955107] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.955211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.955272] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.955646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.955646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.955899] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.955899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.955899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.956156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.956156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.956314] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.956405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.956465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.956617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.956692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.956892] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.956980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.957233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.957387] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.957521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.957605] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dab7827-c31f-472b-b986-30803c457337 is going to be updated. [ 1047.014423] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.014423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.014423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.014663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.014700] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.030359] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: IN_PROGRESS for 2s [ 1047.355192] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.355511] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.355695] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.355977] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.356146] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.356305] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 9cd2f648-de18-4069-aa22-1a8a770b5cb7 not found, creating... [ 1047.356573] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.357142] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.357142] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.357142] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.357852] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.357852] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.357852] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.357852] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.358099] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.358248] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.358442] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 9cd2f648-de18-4069-aa22-1a8a770b5cb7 is going to be created. [ 1047.377346] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.377643] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.377741] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.378078] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.378175] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.378397] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-9cd2f648-de18-4069-aa22-1a8a770b5cb7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.193057] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 1048.193495] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f deletion is rescheduled due to dependency. [ 1048.193495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.302054] env[69637]: INFO networking_nsxv3.common.synchronization [req-bb25ac16-26e2-43cb-b020-55a076417ec2 req-cc852b76-5d72-4fe8-b2f0-0f1e061c829b service nova] Enqueued Resource ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 with Priority: HIGHEST for action security_group_rules [ 1048.302320] env[69637]: INFO networking_nsxv3.common.synchronization [req-bb25ac16-26e2-43cb-b020-55a076417ec2 req-cc852b76-5d72-4fe8-b2f0-0f1e061c829b service nova] Enqueued Resource ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 with Priority: HIGHEST for action security_group_members [ 1048.302588] env[69637]: INFO networking_nsxv3.common.synchronization [req-bb25ac16-26e2-43cb-b020-55a076417ec2 req-cc852b76-5d72-4fe8-b2f0-0f1e061c829b service nova] Enqueued Resource ID: 9cd2f648-de18-4069-aa22-1a8a770b5cb7 with Priority: HIGHEST for action port [ 1048.303086] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 with Priority: HIGHEST for action security_group_rules [ 1048.305404] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 with Priority: HIGHEST for action security_group_members [ 1048.305574] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd2f648-de18-4069-aa22-1a8a770b5cb7 with Priority: HIGHEST for action port [ 1048.306888] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d92d6b5-2ff4-49ef-8464-4c34d82dd192 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.307263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.307263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.307541] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.307663] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d92d6b5-2ff4-49ef-8464-4c34d82dd192',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.308582] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.308701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.308770] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.308948] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.309127] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.309266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.309345] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.309531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.309589] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.309684] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d92d6b5-2ff4-49ef-8464-4c34d82dd192',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.311558] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cd2f648-de18-4069-aa22-1a8a770b5cb7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.311636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cd2f648-de18-4069-aa22-1a8a770b5cb7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.311712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cd2f648-de18-4069-aa22-1a8a770b5cb7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.311911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cd2f648-de18-4069-aa22-1a8a770b5cb7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.311988] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cd2f648-de18-4069-aa22-1a8a770b5cb7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.813320] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.813469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.813953] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d92d6b5-2ff4-49ef-8464-4c34d82dd192',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.814890] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cd2f648-de18-4069-aa22-1a8a770b5cb7 with status ACTIVE [ 1048.815101] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.815707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.815707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.815707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.815707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.815979] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.816117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.816301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.816380] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.816433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.816818] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.816818] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.816818] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.816967] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.816967] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.817113] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cd2f648-de18-4069-aa22-1a8a770b5cb7 is going to be updated. [ 1048.838406] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.838559] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.838736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.838895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.839116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.839304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cd2f648-de18-4069-aa22-1a8a770b5cb7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.045083] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: SUCCESS [ 1049.045288] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.318994] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d92d6b5-2ff4-49ef-8464-4c34d82dd192',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.821149] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.821149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.821149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.822086] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.822086] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.822086] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 is going to be created. [ 1049.844282] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.844282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.844282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.844282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.844282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.853647] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 in Status: UNINITIALIZED for 2s [ 1050.315802] env[69637]: INFO networking_nsxv3.common.synchronization [req-a53d25e9-c60a-4de6-aac6-d4f17cfc008a req-557ccb71-8651-491a-ae07-4aa98d9df560 tempest-ServersTestJSON-1659168521 tempest-ServersTestJSON-1659168521-project-member] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1050.316790] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1050.317147] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.317269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.317339] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.317549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.317693] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.317810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.317866] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.317995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.318092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.318286] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.820581] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.851052] env[69637]: INFO networking_nsxv3.common.synchronization [None req-b5e55902-7b74-48af-a93d-a8a49094db63 None None] Enqueued Resource ID: 81abf877-2727-41e4-a61f-d14b7e61d781 with Priority: HIGHEST for action port [ 1050.851549] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81abf877-2727-41e4-a61f-d14b7e61d781 with Priority: HIGHEST for action port [ 1050.851868] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-81abf877-2727-41e4-a61f-d14b7e61d781 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.852011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81abf877-2727-41e4-a61f-d14b7e61d781" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.852078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81abf877-2727-41e4-a61f-d14b7e61d781" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.852597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81abf877-2727-41e4-a61f-d14b7e61d781" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.852597] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81abf877-2727-41e4-a61f-d14b7e61d781',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.159217] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-286 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.159449] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.159598] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.159860] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.160155] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.160317] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.160441] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.160665] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.160850] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.161260] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.161406] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1051.161522] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1051.161632] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1051.161748] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.163690] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1051.163897] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1051.182537] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1051.182704] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1051.182845] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1051.183047] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.183379] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-16180887-2725-4619-8516-5313b483c23a taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.183559] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-16180887-2725-4619-8516-5313b483c23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.183683] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-16180887-2725-4619-8516-5313b483c23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.184010] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-16180887-2725-4619-8516-5313b483c23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.184158] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16180887-2725-4619-8516-5313b483c23a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.322939] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.354641] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81abf877-2727-41e4-a61f-d14b7e61d781 [ 1051.355037] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.356015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.356015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.356015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.356015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.356015] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81abf877-2727-41e4-a61f-d14b7e61d781 already deleted. [ 1051.356254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81abf877-2727-41e4-a61f-d14b7e61d781" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.687969] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.690131] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.690131] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.690131] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.690131] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.690131] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 16180887-2725-4619-8516-5313b483c23a not found, creating... [ 1051.690131] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.690131] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.690131] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.690131] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.690131] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.690543] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.690543] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.690543] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.691081] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.691277] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.691458] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 16180887-2725-4619-8516-5313b483c23a is going to be created. [ 1051.733402] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.733402] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.733402] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.733402] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.733402] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.733402] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-16180887-2725-4619-8516-5313b483c23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.825219] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.825592] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.825592] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.825703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.825741] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.825880] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1051.862154] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.862277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.862320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.862521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.862663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.880336] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 in Status: SUCCESS [ 1051.880336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.880490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.880814] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.881118] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.881289] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.881358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.881533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.881618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.881703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.881812] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d92d6b5-2ff4-49ef-8464-4c34d82dd192',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.883554] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1052.386446] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.386658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.386761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.387083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.387318] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.387502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.387563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.387798] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.387909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.388078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.388290] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.388422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.388518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.388727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.389586] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.389586] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.389586] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.389586] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.389831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.389831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.389917] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d92d6b5-2ff4-49ef-8464-4c34d82dd192',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.892453] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d92d6b5-2ff4-49ef-8464-4c34d82dd192: rpc.has_security_group_logging(os_id): False [ 1052.915136] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.915136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.915136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.915136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.915136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.916342] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.916342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.916342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.916342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.916342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.916342] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.916342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.916342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.916859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.916859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.916967] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.917073] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.917828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.917828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.917828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.918214] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 is going to be created. [ 1052.990312] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.990588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.990657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.990876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.991118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.014694] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 in Status: IN_PROGRESS for 2s [ 1053.016378] env[69637]: INFO networking_nsxv3.common.synchronization [req-a53d25e9-c60a-4de6-aac6-d4f17cfc008a req-06d46656-fa72-4566-bfc7-3abe99495ed3 service nova] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_rules [ 1053.016556] env[69637]: INFO networking_nsxv3.common.synchronization [req-a53d25e9-c60a-4de6-aac6-d4f17cfc008a req-06d46656-fa72-4566-bfc7-3abe99495ed3 service nova] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1053.016758] env[69637]: INFO networking_nsxv3.common.synchronization [req-a53d25e9-c60a-4de6-aac6-d4f17cfc008a req-06d46656-fa72-4566-bfc7-3abe99495ed3 service nova] Enqueued Resource ID: 16180887-2725-4619-8516-5313b483c23a with Priority: HIGHEST for action port [ 1053.016921] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_rules [ 1053.017139] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1053.017257] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16180887-2725-4619-8516-5313b483c23a with Priority: HIGHEST for action port [ 1053.019369] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.019532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.019602] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.019864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.019972] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.023014] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.023155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.023317] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-16180887-2725-4619-8516-5313b483c23a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.023641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16180887-2725-4619-8516-5313b483c23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.023641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16180887-2725-4619-8516-5313b483c23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.023847] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16180887-2725-4619-8516-5313b483c23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.023847] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16180887-2725-4619-8516-5313b483c23a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.396325] env[69637]: INFO networking_nsxv3.common.synchronization [None req-628ef622-78a1-49ca-9365-54ead3d3f56a None None] Enqueued Resource ID: c1f571d9-4d31-4eeb-bd9c-740960748968 with Priority: HIGHEST for action port [ 1053.398427] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1f571d9-4d31-4eeb-bd9c-740960748968 with Priority: HIGHEST for action port [ 1053.400134] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1f571d9-4d31-4eeb-bd9c-740960748968 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.402038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1f571d9-4d31-4eeb-bd9c-740960748968" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.402038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1f571d9-4d31-4eeb-bd9c-740960748968" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.402038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1f571d9-4d31-4eeb-bd9c-740960748968" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.402038] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1f571d9-4d31-4eeb-bd9c-740960748968',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.524327] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.524479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.525861] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16180887-2725-4619-8516-5313b483c23a with status ACTIVE [ 1053.526074] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.526251] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.526290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.526467] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.526551] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.526721] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.526815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.526887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.527028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.527109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.527277] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.527374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.527420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.527555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.527624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.527703] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16180887-2725-4619-8516-5313b483c23a is going to be updated. [ 1053.547650] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.549148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.549278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.549558] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.550578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.550823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16180887-2725-4619-8516-5313b483c23a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.893490] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1053.893775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.893914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.894142] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.894323] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.894446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.894502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.894653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.894731] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.894825] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.906782] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1f571d9-4d31-4eeb-bd9c-740960748968 [ 1053.906782] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.906782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.906782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.908522] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.908522] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.908522] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1f571d9-4d31-4eeb-bd9c-740960748968 already deleted. [ 1053.908522] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1f571d9-4d31-4eeb-bd9c-740960748968" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.115072] env[69637]: INFO networking_nsxv3.common.synchronization [req-1369b903-b062-4e09-8f2a-65017af2a409 req-8a70d049-5db9-4fcc-a26d-4a1ce842a570 tempest-FloatingIPsAssociationNegativeTestJSON-543408417 tempest-FloatingIPsAssociationNegativeTestJSON-543408417-project-member] Enqueued Resource ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a with Priority: HIGHEST for action security_group_members [ 1054.115641] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a with Priority: HIGHEST for action security_group_members [ 1054.115949] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-726820b1-ac2b-45a1-aaf6-d2c41e47022a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.116477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.116597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.117233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.117559] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.117744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.117931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.118057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.118181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.118351] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('726820b1-ac2b-45a1-aaf6-d2c41e47022a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.397889] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.566798] env[69637]: INFO networking_nsxv3.common.synchronization [req-103967a5-0668-4289-8db0-d60382870fea req-97165c0d-69a4-4cc6-b890-0344cb4d93ad tempest-ServersNegativeTestJSON-962136673 tempest-ServersNegativeTestJSON-962136673-project-member] Enqueued Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_members [ 1054.567404] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_members [ 1054.567736] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.567872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.567935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.568222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.568377] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.568478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.568537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.568762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.568762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.568915] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.620115] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.620292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.620330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.620625] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.620720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.620931] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.621040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.621106] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.621261] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.621338] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.621424] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a is going to be updated. [ 1054.649772] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.650763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.650895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.651141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.651290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.660519] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a in Status: IN_PROGRESS for 2s [ 1054.900048] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.025677] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 in Status: SUCCESS [ 1055.025969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.073075] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.402842] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.403048] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.403086] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.403305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.403395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.403497] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1055.437648] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.437872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.437968] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.438313] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.438975] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.451853] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1055.575660] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.078311] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.078670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.078670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.078749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.080031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.080031] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dab7827-c31f-472b-b986-30803c457337 is going to be updated. [ 1056.115017] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.115224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.115301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.115599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.115812] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.125610] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: IN_PROGRESS for 2s [ 1056.292804] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-149 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.292934] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.293103] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.293480] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.293874] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.296586] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.296586] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.296586] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.296586] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.296586] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.296586] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.296586] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.296586] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.296586] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.296586] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.296586] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.299499] env[69637]: INFO networking_nsxv3.common.synchronization [req-934979d0-4c0c-455e-9f1a-8032c2290a99 req-8b016452-a628-435e-9892-5693f56185af tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f with Priority: HIGHEST for action security_group_members [ 1056.300050] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f with Priority: HIGHEST for action security_group_members [ 1056.300810] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.300810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.300810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.300810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.301053] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.301053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.301053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.301211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.301247] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.301320] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.318159] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.318447] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1056.318685] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.319309] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.319626] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-2c32e8a8-0ede-4efb-8904-3a5304105f8c taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.319740] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.320080] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.320314] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.320548] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c32e8a8-0ede-4efb-8904-3a5304105f8c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.564233] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-19 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.564416] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.564536] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.564815] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.565088] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.565240] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.565354] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.565564] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.565706] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.565982] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.566042] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.566189] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.566250] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.566355] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.566460] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.566586] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.586622] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.586790] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1056.586927] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.587126] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.587436] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-be050344-635b-4705-b242-4b6a5f0e939d taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.587611] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-be050344-635b-4705-b242-4b6a5f0e939d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.587730] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-be050344-635b-4705-b242-4b6a5f0e939d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.588117] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-be050344-635b-4705-b242-4b6a5f0e939d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.588259] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be050344-635b-4705-b242-4b6a5f0e939d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.669229] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a in Status: SUCCESS [ 1056.669408] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 726820b1-ac2b-45a1-aaf6-d2c41e47022a deletion is rescheduled due to dependency. [ 1056.669521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-726820b1-ac2b-45a1-aaf6-d2c41e47022a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.805320] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.805532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.805532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.805764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.805849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.806188] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.806188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.806188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.807745] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.807745] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.807745] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f already deleted. [ 1056.807745] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.823043] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.823290] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.823427] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.823693] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.823846] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.824017] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 2c32e8a8-0ede-4efb-8904-3a5304105f8c not found, creating... [ 1056.824663] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.824871] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.825012] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.825250] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.825375] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.825683] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.825839] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.825958] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.826356] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.826497] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.826656] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 2c32e8a8-0ede-4efb-8904-3a5304105f8c is going to be created. [ 1056.847880] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.848174] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.848269] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.848538] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.848822] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.849064] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.090798] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.091104] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.091174] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.091444] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.091638] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.091749] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port be050344-635b-4705-b242-4b6a5f0e939d not found, creating... [ 1057.092062] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.092180] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.092300] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.092544] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.092695] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.092995] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.093176] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.093313] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.093580] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.093728] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.093873] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: be050344-635b-4705-b242-4b6a5f0e939d is going to be created. [ 1057.112300] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.112491] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.112619] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.112878] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.113155] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.113387] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-be050344-635b-4705-b242-4b6a5f0e939d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.461804] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1057.462187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.462512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.462685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.462929] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.463080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.463147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.463392] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.463535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.463681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.463827] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.546471] env[69637]: INFO networking_nsxv3.common.synchronization [req-df37467a-2ac4-4308-82cb-5b14732a8d5a req-40b67d4f-5bc8-499f-9813-a95585bf2134 service nova] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_rules [ 1057.546750] env[69637]: INFO networking_nsxv3.common.synchronization [req-df37467a-2ac4-4308-82cb-5b14732a8d5a req-40b67d4f-5bc8-499f-9813-a95585bf2134 service nova] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 1057.546995] env[69637]: INFO networking_nsxv3.common.synchronization [req-df37467a-2ac4-4308-82cb-5b14732a8d5a req-40b67d4f-5bc8-499f-9813-a95585bf2134 service nova] Enqueued Resource ID: 2c32e8a8-0ede-4efb-8904-3a5304105f8c with Priority: HIGHEST for action port [ 1057.547674] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_rules [ 1057.549273] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 1057.549273] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c32e8a8-0ede-4efb-8904-3a5304105f8c with Priority: HIGHEST for action port [ 1057.549273] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.549273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.549273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.549273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.549273] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.550340] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.550403] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.550512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.550761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.551026] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.551158] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.551276] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.551513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.551655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.551854] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.552834] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c32e8a8-0ede-4efb-8904-3a5304105f8c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.553019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.553144] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.553385] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.553520] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c32e8a8-0ede-4efb-8904-3a5304105f8c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.770839] env[69637]: INFO networking_nsxv3.common.synchronization [req-934979d0-4c0c-455e-9f1a-8032c2290a99 req-d15a142f-2edb-41e3-834c-208e0ad93d45 service nova] Enqueued Resource ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f with Priority: HIGHEST for action security_group_rules [ 1057.771073] env[69637]: INFO networking_nsxv3.common.synchronization [req-934979d0-4c0c-455e-9f1a-8032c2290a99 req-d15a142f-2edb-41e3-834c-208e0ad93d45 service nova] Enqueued Resource ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f with Priority: HIGHEST for action security_group_members [ 1057.771222] env[69637]: INFO networking_nsxv3.common.synchronization [req-934979d0-4c0c-455e-9f1a-8032c2290a99 req-d15a142f-2edb-41e3-834c-208e0ad93d45 service nova] Enqueued Resource ID: be050344-635b-4705-b242-4b6a5f0e939d with Priority: HIGHEST for action port [ 1057.771723] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f with Priority: HIGHEST for action security_group_rules [ 1057.771850] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f with Priority: HIGHEST for action security_group_members [ 1057.771949] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be050344-635b-4705-b242-4b6a5f0e939d with Priority: HIGHEST for action port [ 1057.772235] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.772361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.772427] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.772617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.772702] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.773493] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.773623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.773663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.773822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.774027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.774166] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.774199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.774327] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.774398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.774563] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.775188] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-be050344-635b-4705-b242-4b6a5f0e939d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.775292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be050344-635b-4705-b242-4b6a5f0e939d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.775358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be050344-635b-4705-b242-4b6a5f0e939d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.775508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be050344-635b-4705-b242-4b6a5f0e939d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.775580] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be050344-635b-4705-b242-4b6a5f0e939d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.966734] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.966942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.966994] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.967351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.967574] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.967703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.967780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.968034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.968141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.968278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.969032] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.969032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.969032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.969032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.969032] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.969341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.969341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.969412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.969504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.969641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.969758] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.056221] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.056935] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.057059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.057206] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c32e8a8-0ede-4efb-8904-3a5304105f8c with status ACTIVE [ 1058.057373] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.057474] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.057587] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.057776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.057900] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.058064] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.058163] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.058221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.058366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.058454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.059135] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.059135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.059135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.059135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.059135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.059135] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c32e8a8-0ede-4efb-8904-3a5304105f8c is going to be updated. [ 1058.081094] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.081259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.081259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.081428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.081579] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.081751] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.137300] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: SUCCESS [ 1058.137653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.278862] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be050344-635b-4705-b242-4b6a5f0e939d with status ACTIVE [ 1058.278862] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.278862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.278862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.278862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.278862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.278862] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.278862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.278862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.279459] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.279459] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.279588] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.279766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.279903] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.280091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.280192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.280306] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be050344-635b-4705-b242-4b6a5f0e939d is going to be updated. [ 1058.281499] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.282454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.282454] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.303451] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.303596] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.303694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.304302] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.304302] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.304302] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be050344-635b-4705-b242-4b6a5f0e939d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.474371] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 156f33af-1675-4f7d-b99d-9e88f58f4cd2: rpc.has_security_group_logging(os_id): False [ 1058.493953] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.494160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.494239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.494454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.494554] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.494755] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.495233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.495233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.495233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.495233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.495602] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.495602] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.495905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.496240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.496363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.496538] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.496648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.496735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.496886] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.496992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.497114] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1058.560580] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.564391] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.564591] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.564591] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.564958] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.565114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.581107] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1058.723630] env[69637]: INFO networking_nsxv3.common.synchronization [req-a71f4b57-603f-46f7-925d-9feaf4da9368 req-e7dc1af6-7783-4289-8530-7bd6ea0aef43 tempest-AttachInterfacesV270Test-270673816 tempest-AttachInterfacesV270Test-270673816-project-member] Enqueued Resource ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 with Priority: HIGHEST for action security_group_members [ 1058.724429] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 with Priority: HIGHEST for action security_group_members [ 1058.724735] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.724974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.724974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.725271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.725437] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.728594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.728594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.728594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.728594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.728594] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bea2b18c-a273-43ed-b1a7-dfa5ed37a831',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.784589] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.063939] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.064120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.064193] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.064409] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.064501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.065416] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be updated. [ 1059.090369] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.090517] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.090587] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.090832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.090945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.099046] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 1059.185489] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-927 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.185798] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-927" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.185836] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-927" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.186671] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-927" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.186671] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.186671] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.186885] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.186984] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.187149] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.187360] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.187477] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.187832] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.187832] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.187832] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.187966] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.188066] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.207131] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.207317] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1059.207465] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.207665] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-927" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.207930] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-21e327d3-c80a-4b1c-8cde-2d230e0eeb8b taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.208125] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-21e327d3-c80a-4b1c-8cde-2d230e0eeb8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.208405] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-21e327d3-c80a-4b1c-8cde-2d230e0eeb8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.208560] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-21e327d3-c80a-4b1c-8cde-2d230e0eeb8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.208866] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e327d3-c80a-4b1c-8cde-2d230e0eeb8b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.228899] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.229084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.229152] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.229323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.229409] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.229588] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.229709] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.229786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.229905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.229982] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.230073] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 already deleted. [ 1059.230154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.289519] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.289681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.289754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.289965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.290064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.290176] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f is going to be created. [ 1059.313209] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.313477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.313477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.313604] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.313756] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.323851] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f in Status: UNINITIALIZED for 2s [ 1059.711844] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.712205] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.712368] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.712733] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.712934] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.713135] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 21e327d3-c80a-4b1c-8cde-2d230e0eeb8b not found, creating... [ 1059.713400] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.713565] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.713686] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.713914] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.714069] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.714358] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.714532] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.714635] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.714855] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.715015] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.715167] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 21e327d3-c80a-4b1c-8cde-2d230e0eeb8b is going to be created. [ 1059.734927] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.735218] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.735331] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.735654] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.735906] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.736186] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-21e327d3-c80a-4b1c-8cde-2d230e0eeb8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.422190] env[69637]: INFO networking_nsxv3.common.synchronization [req-a71f4b57-603f-46f7-925d-9feaf4da9368 req-4b2382c6-99ff-45f1-98a1-889b389ca7a7 service nova] Enqueued Resource ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 with Priority: HIGHEST for action security_group_rules [ 1060.422448] env[69637]: INFO networking_nsxv3.common.synchronization [req-a71f4b57-603f-46f7-925d-9feaf4da9368 req-4b2382c6-99ff-45f1-98a1-889b389ca7a7 service nova] Enqueued Resource ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 with Priority: HIGHEST for action security_group_members [ 1060.422571] env[69637]: INFO networking_nsxv3.common.synchronization [req-a71f4b57-603f-46f7-925d-9feaf4da9368 req-4b2382c6-99ff-45f1-98a1-889b389ca7a7 service nova] Enqueued Resource ID: 21e327d3-c80a-4b1c-8cde-2d230e0eeb8b with Priority: HIGHEST for action port [ 1060.422772] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 with Priority: HIGHEST for action security_group_rules [ 1060.422899] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 with Priority: HIGHEST for action security_group_members [ 1060.422996] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21e327d3-c80a-4b1c-8cde-2d230e0eeb8b with Priority: HIGHEST for action port [ 1060.423647] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bea2b18c-a273-43ed-b1a7-dfa5ed37a831 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.423776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.423846] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.424109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.424190] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bea2b18c-a273-43ed-b1a7-dfa5ed37a831',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.426421] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.426421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.426421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.426421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.426421] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.426421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.426421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.426421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.426421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.426421] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bea2b18c-a273-43ed-b1a7-dfa5ed37a831',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.427101] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-21e327d3-c80a-4b1c-8cde-2d230e0eeb8b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.427101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21e327d3-c80a-4b1c-8cde-2d230e0eeb8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.427101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21e327d3-c80a-4b1c-8cde-2d230e0eeb8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.427101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21e327d3-c80a-4b1c-8cde-2d230e0eeb8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.427101] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e327d3-c80a-4b1c-8cde-2d230e0eeb8b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.596594] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1060.596893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.928633] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.928796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.928965] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bea2b18c-a273-43ed-b1a7-dfa5ed37a831',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.929994] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21e327d3-c80a-4b1c-8cde-2d230e0eeb8b with status ACTIVE [ 1060.930925] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.930925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.930925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.930925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.930925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.930925] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.931254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.931254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.931254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.931254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.931442] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.932161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.932161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.932161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.932161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.932161] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21e327d3-c80a-4b1c-8cde-2d230e0eeb8b is going to be updated. [ 1060.951641] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.951641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.951641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.951837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.951955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.952135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21e327d3-c80a-4b1c-8cde-2d230e0eeb8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.109447] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 1061.109582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.109898] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.110221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.110482] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.110698] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.110765] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.110969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.111149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.111332] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.111523] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.162913] env[69637]: INFO networking_nsxv3.common.synchronization [req-0e2e4cd0-4f73-42d6-881d-9d457a276952 req-9df7e2a8-87c6-4351-9900-38c87b13854f tempest-ServerActionsTestOtherB-2018875684 tempest-ServerActionsTestOtherB-2018875684-project-member] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1061.163497] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1061.163796] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.163942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.164011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.164243] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.164388] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.164486] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.164552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.164775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.164775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.164872] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.332714] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f in Status: SUCCESS [ 1061.332933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.333113] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.333326] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.333508] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.333625] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.333685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.333831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.333909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.333993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.334145] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.434571] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bea2b18c-a273-43ed-b1a7-dfa5ed37a831',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.507792] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-680 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.508810] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.508810] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.508810] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.508810] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.509029] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.509029] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.509197] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.509341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.509546] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1061.509758] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1061.509804] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1061.509906] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1061.510069] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1061.510166] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1061.510277] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1061.528477] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1061.528644] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1061.528798] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1061.528985] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.529305] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-390a0658-817e-4ca2-92b5-212eb564b7df taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.529486] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-390a0658-817e-4ca2-92b5-212eb564b7df" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.529610] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-390a0658-817e-4ca2-92b5-212eb564b7df" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.529948] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-390a0658-817e-4ca2-92b5-212eb564b7df" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.530110] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('390a0658-817e-4ca2-92b5-212eb564b7df',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.617265] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.617428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.617501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.617717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.617913] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.618032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.618098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.618260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.618346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.618433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.618575] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.618666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.618720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.618856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.618990] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.619091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.619144] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.619280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.619352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.619431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.619518] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.673209] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.673345] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.673394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.673605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.673684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.673878] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.673994] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.674053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.674188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.674259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.674348] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 already deleted. [ 1061.674415] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.837222] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.879964] env[69637]: INFO networking_nsxv3.common.synchronization [req-d298ed1a-3936-4722-bb9e-1297602a0c75 req-c6d8f304-c01b-475c-9234-af9aa4ffb3fa tempest-ServerDiagnosticsTest-1230345668 tempest-ServerDiagnosticsTest-1230345668-project-member] Enqueued Resource ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 with Priority: HIGHEST for action security_group_members [ 1061.880829] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 with Priority: HIGHEST for action security_group_members [ 1061.881191] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.881321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.881386] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.881599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.881796] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.881915] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.881974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.882498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.883064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.883064] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d92d6b5-2ff4-49ef-8464-4c34d82dd192',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.935866] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.936175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.936175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.936320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.936417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.936510] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 is going to be created. [ 1061.960098] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.960267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.960311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.960518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.960685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.972427] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 in Status: UNINITIALIZED for 2s [ 1062.032597] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.032835] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.032967] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.033277] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.033432] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.033595] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 390a0658-817e-4ca2-92b5-212eb564b7df not found, creating... [ 1062.033859] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.034073] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.034219] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.034375] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.034516] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.034808] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.034969] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.035103] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.035316] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.035453] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.035597] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 390a0658-817e-4ca2-92b5-212eb564b7df is going to be created. [ 1062.060026] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.060441] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.060516] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.060768] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.061014] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.061254] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-390a0658-817e-4ca2-92b5-212eb564b7df" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.121973] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f55a00f-c3f8-407e-be41-257b4c01874f: rpc.has_security_group_logging(os_id): False [ 1062.163451] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.163631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.163631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.163917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.164053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.164250] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.164370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.164439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.164613] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.164701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.164908] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.165014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.165099] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.165250] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.165337] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.165529] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.165624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.165696] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.165869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.165949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.166079] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be updated. [ 1062.253108] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.253258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.253344] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.253590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.253749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.266137] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 1062.341403] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f: rpc.has_security_group_logging(os_id): False [ 1062.359366] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.359516] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.359588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.359832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.359919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.360179] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.360285] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.360348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.360615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.360615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.360950] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f is going to be created. [ 1062.385816] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.385985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.386100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.386280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.386374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.386565] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.386721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.386721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.386864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.386943] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.387038] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 is going to be updated. [ 1062.422221] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.422388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.423665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.423665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.423665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.436266] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 in Status: IN_PROGRESS for 2s [ 1062.440851] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.440990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.441115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.441272] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.441452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.454450] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f in Status: IN_PROGRESS for 2s [ 1062.948508] env[69637]: INFO networking_nsxv3.common.synchronization [req-0e2e4cd0-4f73-42d6-881d-9d457a276952 req-71d390a7-50bd-49c3-af6a-fab63f0b5198 service nova] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_rules [ 1062.949980] env[69637]: INFO networking_nsxv3.common.synchronization [req-0e2e4cd0-4f73-42d6-881d-9d457a276952 req-71d390a7-50bd-49c3-af6a-fab63f0b5198 service nova] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1062.951016] env[69637]: INFO networking_nsxv3.common.synchronization [req-0e2e4cd0-4f73-42d6-881d-9d457a276952 req-71d390a7-50bd-49c3-af6a-fab63f0b5198 service nova] Enqueued Resource ID: 390a0658-817e-4ca2-92b5-212eb564b7df with Priority: HIGHEST for action port [ 1062.951016] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_rules [ 1062.951016] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1062.951619] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390a0658-817e-4ca2-92b5-212eb564b7df with Priority: HIGHEST for action port [ 1062.952371] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.952371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.952371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.952371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.952371] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.954849] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.954967] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.955049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.955228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.955378] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.955477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.955545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.955700] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.955796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.955891] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.956945] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-390a0658-817e-4ca2-92b5-212eb564b7df taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.957072] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-390a0658-817e-4ca2-92b5-212eb564b7df" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.957139] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-390a0658-817e-4ca2-92b5-212eb564b7df" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.957330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-390a0658-817e-4ca2-92b5-212eb564b7df" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.961019] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('390a0658-817e-4ca2-92b5-212eb564b7df',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.460058] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.460387] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.460426] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.461531] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 390a0658-817e-4ca2-92b5-212eb564b7df with status ACTIVE [ 1063.461665] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.461814] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.461947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.462250] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.462353] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.462482] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.462583] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.462648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.462805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.462884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.463373] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.463373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.463373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.463598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.463637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.463728] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 390a0658-817e-4ca2-92b5-212eb564b7df is going to be updated. [ 1063.483133] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.483351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.483351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.483541] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.483675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.483832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-390a0658-817e-4ca2-92b5-212eb564b7df" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.966116] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.983630] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 in Status: SUCCESS [ 1063.984793] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.985282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.985565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.985860] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.986056] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.986056] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.986210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.986291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.986377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.986470] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bea2b18c-a273-43ed-b1a7-dfa5ed37a831',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.278281] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 1064.278524] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.445507] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 in Status: SUCCESS [ 1064.445507] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d92d6b5-2ff4-49ef-8464-4c34d82dd192 deletion is rescheduled due to dependency. [ 1064.445669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d92d6b5-2ff4-49ef-8464-4c34d82dd192" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.462948] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f in Status: SUCCESS [ 1064.463245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.468786] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.469119] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.469119] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.469343] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.469471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.469596] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 is going to be created. [ 1064.492147] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.492309] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.492380] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.495273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.495273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.495273] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.495273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.495273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.495273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.495273] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.495273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.495273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.495273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.495273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.495273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.496053] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.496053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.496053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.496053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.496194] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.496319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.496365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.496490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.496568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.496641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.496729] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bea2b18c-a273-43ed-b1a7-dfa5ed37a831',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.505992] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: UNINITIALIZED for 2s [ 1064.999374] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bea2b18c-a273-43ed-b1a7-dfa5ed37a831: rpc.has_security_group_logging(os_id): False [ 1065.017075] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.017267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.017322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.017580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.017682] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.017864] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.017983] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.018046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.018207] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.018288] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.018503] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.018629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.018699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.018804] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.018893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.019218] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.019391] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.019545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.019778] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.019927] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.020061] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 is going to be created. [ 1065.081974] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.082224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.082292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.082573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.082842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.097950] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 in Status: IN_PROGRESS for 2s [ 1066.126827] env[69637]: INFO networking_nsxv3.common.synchronization [req-321f02dc-2592-44c3-8e79-dec522bdea4b req-be4a6099-dffc-47ce-8646-ad7c51385bb7 tempest-ImagesOneServerNegativeTestJSON-1586387438 tempest-ImagesOneServerNegativeTestJSON-1586387438-project-member] Enqueued Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1066.127139] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1066.127525] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.127643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.127708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.128121] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.128304] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.128956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.128956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.128956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.128956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.128956] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.460164] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-546 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.460359] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-546" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.460486] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-546" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.461080] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-546" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.461348] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.461513] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.461637] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.461909] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.462135] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.462328] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.462446] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1066.462570] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1066.462715] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1066.462852] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.462924] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1066.463074] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1066.481796] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1066.481796] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1066.481796] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1066.481796] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-546" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.481796] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-f375dcfc-fa03-4505-823f-6440cb1d56b0 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.481796] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-f375dcfc-fa03-4505-823f-6440cb1d56b0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.481796] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-f375dcfc-fa03-4505-823f-6440cb1d56b0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.481796] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-f375dcfc-fa03-4505-823f-6440cb1d56b0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.482284] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f375dcfc-fa03-4505-823f-6440cb1d56b0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.513862] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: SUCCESS [ 1066.514118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.514282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.514509] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.518020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.518020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.518020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.518020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.518020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.518020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.518020] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.631738] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.631893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.631965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.632196] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.632285] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.632469] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.632567] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.632629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.632774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.632848] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.632931] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 already deleted. [ 1066.633066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.920651] env[69637]: INFO networking_nsxv3.common.synchronization [req-4f8360da-f104-4b3c-a408-51ba7ed68e4d req-4a081e5f-3183-484d-a22b-6ddb7f201c3f tempest-ServerDiskConfigTestJSON-538739594 tempest-ServerDiskConfigTestJSON-538739594-project-member] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 1066.921224] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 1066.921544] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.921672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.921749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.921959] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.922140] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.922463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.922544] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.922701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.922803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.922901] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.984661] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.984902] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.985080] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.985402] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.985582] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.985766] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port f375dcfc-fa03-4505-823f-6440cb1d56b0 not found, creating... [ 1066.986077] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.986265] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.986404] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.986684] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.986851] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.987205] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.987372] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.987526] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.987748] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.987891] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.988072] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: f375dcfc-fa03-4505-823f-6440cb1d56b0 is going to be created. [ 1067.011193] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.011406] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.011546] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.011844] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.012101] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.012307] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-f375dcfc-fa03-4505-823f-6440cb1d56b0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.018173] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.117617] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 in Status: SUCCESS [ 1067.117894] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.425836] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.425836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.425836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.425836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.426460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.426460] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.426460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.426460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.426460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.426702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.426702] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 1067.455856] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.456030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.456090] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.456310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.456458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.465432] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 1067.520395] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abc9ca0b-4c93-42fd-9003-750112e8dab1: rpc.has_security_group_logging(os_id): False [ 1067.538060] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.538218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.538288] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.538499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.538590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.538836] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.538935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.539009] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.539163] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.539238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.539324] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 is going to be created. [ 1067.592516] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.592762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.592836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.593552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.593852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.606520] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: IN_PROGRESS for 2s [ 1067.755349] env[69637]: INFO networking_nsxv3.common.synchronization [req-321f02dc-2592-44c3-8e79-dec522bdea4b req-e5d7672e-41ab-448c-bb5b-13a086ecd000 service nova] Enqueued Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_rules [ 1067.755618] env[69637]: INFO networking_nsxv3.common.synchronization [req-321f02dc-2592-44c3-8e79-dec522bdea4b req-e5d7672e-41ab-448c-bb5b-13a086ecd000 service nova] Enqueued Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1067.755821] env[69637]: INFO networking_nsxv3.common.synchronization [req-321f02dc-2592-44c3-8e79-dec522bdea4b req-e5d7672e-41ab-448c-bb5b-13a086ecd000 service nova] Enqueued Resource ID: f375dcfc-fa03-4505-823f-6440cb1d56b0 with Priority: HIGHEST for action port [ 1067.756448] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_rules [ 1067.756654] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1067.756769] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f375dcfc-fa03-4505-823f-6440cb1d56b0 with Priority: HIGHEST for action port [ 1067.759350] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.760806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.762231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.762231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.762231] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.762412] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.762504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.762580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.762814] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.762888] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.763045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.763127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.763834] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.763834] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.763834] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.764604] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-f375dcfc-fa03-4505-823f-6440cb1d56b0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.764604] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f375dcfc-fa03-4505-823f-6440cb1d56b0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.764604] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f375dcfc-fa03-4505-823f-6440cb1d56b0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.764991] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f375dcfc-fa03-4505-823f-6440cb1d56b0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.764991] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f375dcfc-fa03-4505-823f-6440cb1d56b0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.266399] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.266533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.266701] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.267930] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f375dcfc-fa03-4505-823f-6440cb1d56b0 with status ACTIVE [ 1068.268146] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.268252] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.268323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.268512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.268599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.268765] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.268859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.268920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.269928] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.270063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.270288] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.270413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.270475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.270711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.270793] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.270838] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f375dcfc-fa03-4505-823f-6440cb1d56b0 is going to be updated. [ 1068.297925] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.298104] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.298173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.298376] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.298517] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.298682] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f375dcfc-fa03-4505-823f-6440cb1d56b0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.772460] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.275271] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.275424] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.275496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.275735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.275791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.275897] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 is going to be created. [ 1069.314683] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.314683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.314683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.314683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.314683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.325555] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: UNINITIALIZED for 2s [ 1069.474537] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 1069.474537] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac deletion is rescheduled due to dependency. [ 1069.474815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.722787] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: SUCCESS [ 1069.722787] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.111276] env[69637]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1071.111477] env[69637]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1071.336733] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: SUCCESS [ 1071.337028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.337218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.337650] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.337650] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.338182] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.338182] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.338182] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.338182] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.338182] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.338435] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.843837] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.844329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.844329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.844440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.844628] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.844743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.844844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.845087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.845207] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.845325] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.845533] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.845657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.845753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.845946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.846152] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.846287] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.846362] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.846526] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.846607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.846689] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.846795] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.350302] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 938515a1-124c-4a31-9c35-b1d93a6612b5: rpc.has_security_group_logging(os_id): False [ 1072.374545] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.374545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.374545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.374545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.374545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.374545] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.374545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.374545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.374545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.374545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.376297] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.376297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.376297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.376297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.376297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.376297] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.376297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.376297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.376297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.376297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.376297] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 is going to be created. [ 1072.429227] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.429421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.429502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.429680] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.429867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.440030] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: IN_PROGRESS for 2s [ 1072.758156] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1072.758248] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1073.953499] env[69637]: INFO networking_nsxv3.common.synchronization [None req-79c53107-4507-4b2b-9c1e-edf7d05d8aef None None] Enqueued Resource ID: 280e1b1e-5ed9-48a1-8be8-36accdc494bc with Priority: HIGHEST for action port [ 1073.954820] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280e1b1e-5ed9-48a1-8be8-36accdc494bc with Priority: HIGHEST for action port [ 1073.954820] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-280e1b1e-5ed9-48a1-8be8-36accdc494bc taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.954820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-280e1b1e-5ed9-48a1-8be8-36accdc494bc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.955122] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-280e1b1e-5ed9-48a1-8be8-36accdc494bc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.955623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-280e1b1e-5ed9-48a1-8be8-36accdc494bc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.955773] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('280e1b1e-5ed9-48a1-8be8-36accdc494bc',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.453467] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: SUCCESS [ 1074.453713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.458165] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 280e1b1e-5ed9-48a1-8be8-36accdc494bc [ 1074.458384] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.458512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.458573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.458880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.458880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.458995] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:280e1b1e-5ed9-48a1-8be8-36accdc494bc already deleted. [ 1074.459046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-280e1b1e-5ed9-48a1-8be8-36accdc494bc" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.698248] env[69637]: INFO networking_nsxv3.common.synchronization [req-9e8da422-08c4-4b4c-91cb-84168396259c req-bd46d6d9-8e5f-463d-98cc-14a05110394e tempest-ServersTestJSON-1659168521 tempest-ServersTestJSON-1659168521-project-member] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1074.699087] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1074.699533] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.700529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.700529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.700529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.700529] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.700747] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.700747] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.701728] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.701728] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.701728] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.069484] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.069484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.069484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.069941] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.069941] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.203813] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-286 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.204058] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.204199] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.204469] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.204749] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.205014] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.205184] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.205402] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.205597] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.205758] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.205868] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.206586] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.206586] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.206586] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.206586] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.206586] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.208677] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.232299] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.232614] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1075.232849] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.233143] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.233626] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-13d6ba04-e356-49fe-8f8c-f02e097bdabe taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.233910] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-13d6ba04-e356-49fe-8f8c-f02e097bdabe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.234183] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-13d6ba04-e356-49fe-8f8c-f02e097bdabe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.234677] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-13d6ba04-e356-49fe-8f8c-f02e097bdabe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.234915] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13d6ba04-e356-49fe-8f8c-f02e097bdabe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.398054] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-149 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.398054] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.398054] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.398054] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.398054] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.398054] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.398054] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.398054] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.398700] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.399251] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.399585] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.399840] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.400095] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.400424] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.400625] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.401054] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.421561] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.421561] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1075.421561] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.421561] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-149" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.421561] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-2c32e8a8-0ede-4efb-8904-3a5304105f8c taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.421561] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.421561] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.421561] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.421561] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c32e8a8-0ede-4efb-8904-3a5304105f8c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.522401] env[69637]: INFO networking_nsxv3.common.synchronization [req-741aaf72-3518-43ec-9a5b-1dc217b13b0e req-a09de41b-9e78-41b6-8d19-2ed9377d92ef tempest-ServersWithSpecificFlavorTestJSON-315105085 tempest-ServersWithSpecificFlavorTestJSON-315105085-project-member] Enqueued Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_members [ 1075.523022] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGHEST for action security_group_members [ 1075.523395] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-108f5aaf-b223-4e3b-b27d-aa7c7e251598 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.523540] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.523611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.523831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.524027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.524112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.524178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.524316] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.524444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.524527] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.574210] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.714102] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.737885] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.737885] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.737885] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.738172] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.738172] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.738437] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 13d6ba04-e356-49fe-8f8c-f02e097bdabe not found, creating... [ 1075.738555] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.738771] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.738844] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.739117] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.739204] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.742176] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.742176] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.742176] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.742176] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.742176] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.742176] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 13d6ba04-e356-49fe-8f8c-f02e097bdabe is going to be created. [ 1075.760670] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.762020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.762020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.762020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.762020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.762020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-13d6ba04-e356-49fe-8f8c-f02e097bdabe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.925975] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.926161] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.926296] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.926568] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.926744] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.927047] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.927208] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.927328] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.927547] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.927683] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.927963] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.928134] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.928253] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.928475] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.928617] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.928764] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 2c32e8a8-0ede-4efb-8904-3a5304105f8c is going to be updated. [ 1075.958709] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.959302] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.959302] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.959512] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.959573] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.959774] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.028121] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.028849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.028969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.029402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.029528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.030173] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.030296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.030358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.030521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.030723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.031314] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 is going to be updated. [ 1076.058078] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.058250] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.058250] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.058437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.058553] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.070019] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 in Status: IN_PROGRESS for 2s [ 1076.078931] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.120571] env[69637]: INFO networking_nsxv3.common.synchronization [req-5811b3a2-122a-46de-a1be-e8ceab898304 req-1fc0d646-7c99-42eb-bf60-cd14296a05d2 tempest-AttachInterfacesV270Test-270673816 tempest-AttachInterfacesV270Test-270673816-project-member] Enqueued Resource ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 with Priority: HIGHEST for action security_group_members [ 1076.121083] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 with Priority: HIGHEST for action security_group_members [ 1076.121385] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.121507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.121575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.121778] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.121927] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.122235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.122303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.122450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.122536] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.122632] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bea2b18c-a273-43ed-b1a7-dfa5ed37a831',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.217319] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.219260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.219260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.219260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.219260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.219260] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1076.247622] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.248322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.248322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.248322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.248322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.257339] env[69637]: INFO networking_nsxv3.common.synchronization [None req-96f9a9f4-89a4-4a1b-8062-fe6456f970a2 None None] Enqueued Resource ID: 0524f79b-720b-4aca-8223-ebe3ef2ba9a1 with Priority: HIGHEST for action port [ 1076.257570] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0524f79b-720b-4aca-8223-ebe3ef2ba9a1 with Priority: HIGHEST for action port [ 1076.258916] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-0524f79b-720b-4aca-8223-ebe3ef2ba9a1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.258916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0524f79b-720b-4aca-8223-ebe3ef2ba9a1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.258916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0524f79b-720b-4aca-8223-ebe3ef2ba9a1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.258916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0524f79b-720b-4aca-8223-ebe3ef2ba9a1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.258916] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0524f79b-720b-4aca-8223-ebe3ef2ba9a1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.262570] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1076.491978] env[69637]: INFO networking_nsxv3.common.synchronization [req-9e8da422-08c4-4b4c-91cb-84168396259c req-751bff48-0198-433e-861e-ab1dee9f9c12 service nova] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_rules [ 1076.492306] env[69637]: INFO networking_nsxv3.common.synchronization [req-9e8da422-08c4-4b4c-91cb-84168396259c req-751bff48-0198-433e-861e-ab1dee9f9c12 service nova] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1076.492486] env[69637]: INFO networking_nsxv3.common.synchronization [req-9e8da422-08c4-4b4c-91cb-84168396259c req-751bff48-0198-433e-861e-ab1dee9f9c12 service nova] Enqueued Resource ID: 13d6ba04-e356-49fe-8f8c-f02e097bdabe with Priority: HIGHEST for action port [ 1076.492966] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_rules [ 1076.493247] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1076.493348] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d6ba04-e356-49fe-8f8c-f02e097bdabe with Priority: HIGHEST for action port [ 1076.493667] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.493815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.493902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.494152] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.494274] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.497331] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.497441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.497635] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-13d6ba04-e356-49fe-8f8c-f02e097bdabe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.497734] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13d6ba04-e356-49fe-8f8c-f02e097bdabe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.497789] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13d6ba04-e356-49fe-8f8c-f02e097bdabe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.497986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13d6ba04-e356-49fe-8f8c-f02e097bdabe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.498098] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13d6ba04-e356-49fe-8f8c-f02e097bdabe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.578627] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1076.578753] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1076.625057] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.625283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.625529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.625529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.625663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.625834] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.625934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.626016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.626168] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.626260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.626315] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 is going to be updated. [ 1076.670986] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.670986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.670986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.670986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.671197] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.686854] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 in Status: IN_PROGRESS for 2s [ 1076.731575] env[69637]: INFO networking_nsxv3.common.synchronization [req-9fd64a07-ec72-4bd2-b869-2a657d14ef0c req-27d4d0e9-adce-4c8a-8172-a174f68e384c service nova] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_rules [ 1076.731795] env[69637]: INFO networking_nsxv3.common.synchronization [req-9fd64a07-ec72-4bd2-b869-2a657d14ef0c req-27d4d0e9-adce-4c8a-8172-a174f68e384c service nova] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 1076.731936] env[69637]: INFO networking_nsxv3.common.synchronization [req-9fd64a07-ec72-4bd2-b869-2a657d14ef0c req-27d4d0e9-adce-4c8a-8172-a174f68e384c service nova] Enqueued Resource ID: 2c32e8a8-0ede-4efb-8904-3a5304105f8c with Priority: HIGHEST for action port [ 1076.732593] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_rules [ 1076.732706] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 1076.732811] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c32e8a8-0ede-4efb-8904-3a5304105f8c with Priority: HIGHEST for action port [ 1076.733355] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.733355] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.733355] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.733609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.733718] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.734576] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.734879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.734879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.735608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.735608] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.735608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.735608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.735608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.735608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.736373] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.736623] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c32e8a8-0ede-4efb-8904-3a5304105f8c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.736623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.736623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.736844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.736897] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c32e8a8-0ede-4efb-8904-3a5304105f8c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.764781] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0524f79b-720b-4aca-8223-ebe3ef2ba9a1 [ 1076.765048] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.765138] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.765195] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.765393] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.765475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.765561] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0524f79b-720b-4aca-8223-ebe3ef2ba9a1 already deleted. [ 1076.765637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0524f79b-720b-4aca-8223-ebe3ef2ba9a1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.003099] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13d6ba04-e356-49fe-8f8c-f02e097bdabe with status ACTIVE [ 1077.003684] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.003684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.003684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.003684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.003976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.003976] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.003976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.004107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.004199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.004284] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.004462] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.004555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.004616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.004754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.004840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.004923] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13d6ba04-e356-49fe-8f8c-f02e097bdabe is going to be updated. [ 1077.006226] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.006350] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.026312] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.026616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.026693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.026876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.027009] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.027161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13d6ba04-e356-49fe-8f8c-f02e097bdabe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.141522] env[69637]: INFO networking_nsxv3.common.synchronization [req-c56d320c-6b5f-44e7-9aba-cee221b931d4 req-b9ff6b03-1836-430e-ae1a-288ba1004a43 tempest-ServerDiskConfigTestJSON-538739594 tempest-ServerDiskConfigTestJSON-538739594-project-member] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 1077.141522] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 1077.141522] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.141522] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.141935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.141935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.141935] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.142049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.142466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.142466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.142466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.142466] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.240854] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.240854] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.240854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.240854] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c32e8a8-0ede-4efb-8904-3a5304105f8c with status ACTIVE [ 1077.240854] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.240854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.240854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.240854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.240854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.240854] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.240854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.240854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.241603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.241603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.241740] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.241904] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.242059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.242328] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.242557] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.242736] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c32e8a8-0ede-4efb-8904-3a5304105f8c is going to be updated. [ 1077.269852] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.270033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.270103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.270370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.270509] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.270668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c32e8a8-0ede-4efb-8904-3a5304105f8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.429377] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-185 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.429620] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.429801] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.430115] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.430445] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.430667] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.430815] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.431112] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.431323] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.431576] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.431697] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.431813] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.431924] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.432049] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.432188] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.432390] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.450309] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.450474] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1077.450539] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.450748] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-185" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.451153] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-b1b77dbe-4bbf-43d6-8192-92156111d595 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.451384] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-b1b77dbe-4bbf-43d6-8192-92156111d595" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.451539] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-b1b77dbe-4bbf-43d6-8192-92156111d595" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.451908] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-b1b77dbe-4bbf-43d6-8192-92156111d595" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.452092] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1b77dbe-4bbf-43d6-8192-92156111d595',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.477973] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.478168] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.478274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.478536] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.493566] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1077.494560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.495574] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1077.530671] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.530671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.530935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.530971] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.544363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.545279] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1077.545464] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1077.545632] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1077.585469] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.585788] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.585788] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.585962] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.588064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.589083] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1077.645214] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.645458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.645526] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.645744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.667351] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.667608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.667608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.667826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.668268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.668597] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1077.670631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.670894] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.671058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.671154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.671320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.671499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.671499] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 1077.698135] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.698135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.698135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.698135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.698135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.707273] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 1077.744500] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.744500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.745068] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.745209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.745624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.746035] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:47. [ 1077.746216] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'938515a1-124c-4a31-9c35-b1d93a6612b5', 'abc9ca0b-4c93-42fd-9003-750112e8dab1', '26287d78-a077-45b2-9f9c-fbff1368c591', '5b978e6a-7c34-4af8-a48f-77dd3db23234', '108f5aaf-b223-4e3b-b27d-aa7c7e251598', '0c35ee80-fc38-4bea-b273-773d4bf4b918', 'ad77a84e-935d-4f36-9c82-e497b2b9c639', '4dab7827-c31f-472b-b986-30803c457337', '7ff0c3ba-5135-40b4-ae76-b08804b8ec7d', 'ab904195-351a-49c6-8462-7f952d95cf87', 'dc8c512a-6092-4e87-9d42-efdd0a8ab3f4', 'bac27816-ae12-436b-86da-6c4bbde7b2ac', '1236a1fa-0205-4a17-909f-c8686b475a69', '506fca2b-4bdc-418f-be44-db369f7e1332', '1db16c79-2ca0-4113-99b1-64acc68fd18a', 'fff10d50-5957-443e-a8f3-dc5ad9677624', 'eb74dbe6-1fe7-4183-b9a2-aad8d748259e', 'da183859-be41-4684-a134-dc3c3fac0ab7', 'bff14a3b-698b-4fee-8b4e-d724ef23de40', '8f38a6b0-1f81-42d8-9f18-8deb24c569fe', '5fb52e9e-114d-48d5-9b9e-c3f299243e92', 'cc38a146-8a93-4507-a45a-aaf042f5e30b', '9ebf57d6-6da5-49a3-83b3-8e08d42464db', '77e45333-e861-4952-94f1-dfd9a9a2ed58', '15e5246e-0aad-4687-8222-4618f13b02fa', 'ab63da8d-6ab8-41b7-8884-d191739821cb', '2bea8a67-35df-45be-bf57-95c80494d7fe', 'bea2b18c-a273-43ed-b1a7-dfa5ed37a831', '67b79615-8ab9-4c90-bd99-6702f487431a', '156f33af-1675-4f7d-b99d-9e88f58f4cd2', '2f55a00f-c3f8-407e-be41-257b4c01874f', '69c7681d-644f-47c6-8228-9fc17f49b5a3', 'c5de72fa-d001-40b6-8ce0-d5b858d8f9d0', '8d51299a-8425-4d04-b702-fb6eebeef65f', '7d92d6b5-2ff4-49ef-8464-4c34d82dd192', '5e078c82-40fd-4661-9911-198585d187a7', 'f6b27dfc-30ce-43c0-922c-60d619d56e60', '726820b1-ac2b-45a1-aaf6-d2c41e47022a', '9d9cb429-99aa-4837-be4a-8fc93149f9fb', 'fb173e06-7b41-4fdf-ae0b-3bb378905a07', 'ed080368-c954-48e2-a0f1-c55ff7a728fd', '9f700376-4f24-4ccd-a620-7a4e934d5a40', '0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f', '5113e882-e54a-4682-8961-555e92283cef', '23bbf0c1-9856-41c8-b206-759ddb9f7695', 'fefafe98-8990-454a-a252-19be0a2a5042', 'ff9b407c-6313-458e-a95d-b00d9b8914d1'} {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1077.746341] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1077.747515] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.765912] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.766316] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.766316] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.766523] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.766659] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.766788] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1077.766866] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1077.766943] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1077.851904] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.852075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.852192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.852383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.853539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.853832] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1077.853928] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1077.854016] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1077.854095] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1077.854193] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/47 resources of Type:Security Group Rules [ 1077.854272] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGH for action security_group_rules [ 1077.854356] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGH for action security_group_rules [ 1077.854423] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGH for action security_group_rules [ 1077.854487] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGH for action security_group_rules [ 1077.854565] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGH for action security_group_rules [ 1077.854640] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGH for action security_group_rules [ 1077.854704] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGH for action security_group_rules [ 1077.854768] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGH for action security_group_rules [ 1077.855123] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d with Priority: HIGH for action security_group_rules [ 1077.855123] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGH for action security_group_rules [ 1077.855123] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGH for action security_group_rules [ 1077.855123] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGH for action security_group_rules [ 1077.855123] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1236a1fa-0205-4a17-909f-c8686b475a69 with Priority: HIGH for action security_group_rules [ 1077.855497] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGH for action security_group_rules [ 1077.855497] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGH for action security_group_rules [ 1077.855497] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fff10d50-5957-443e-a8f3-dc5ad9677624 with Priority: HIGH for action security_group_rules [ 1077.855497] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e with Priority: HIGH for action security_group_rules [ 1077.855497] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da183859-be41-4684-a134-dc3c3fac0ab7 with Priority: HIGH for action security_group_rules [ 1077.855497] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGH for action security_group_rules [ 1077.855756] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGH for action security_group_rules [ 1077.855756] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.955963] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.955963] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.955963] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.955963] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.955963] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.955963] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port b1b77dbe-4bbf-43d6-8192-92156111d595 not found, creating... [ 1077.955963] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.955963] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.956297] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.956297] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.957223] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.957223] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.957223] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.957223] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.957514] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.957679] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.958127] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: b1b77dbe-4bbf-43d6-8192-92156111d595 is going to be created. [ 1077.978803] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.979104] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.979257] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.979551] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.979798] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.980108] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-b1b77dbe-4bbf-43d6-8192-92156111d595" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.080484] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 in Status: SUCCESS [ 1078.080772] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 deletion is rescheduled due to dependency. [ 1078.080976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.250967] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.251315] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.251369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.251678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.251816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.251962] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be updated. [ 1078.281072] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1078.281386] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.281548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.281762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.281952] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.282079] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.282148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.282295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.282372] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.282467] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.290238] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.290238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.290238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.290238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.290452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.301698] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 1078.689840] env[69637]: INFO networking_nsxv3.common.synchronization [req-c56d320c-6b5f-44e7-9aba-cee221b931d4 req-8860dc4c-a7d0-4084-8209-c03d2c8efbe0 service nova] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_rules [ 1078.690026] env[69637]: INFO networking_nsxv3.common.synchronization [req-c56d320c-6b5f-44e7-9aba-cee221b931d4 req-8860dc4c-a7d0-4084-8209-c03d2c8efbe0 service nova] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 1078.690173] env[69637]: INFO networking_nsxv3.common.synchronization [req-c56d320c-6b5f-44e7-9aba-cee221b931d4 req-8860dc4c-a7d0-4084-8209-c03d2c8efbe0 service nova] Enqueued Resource ID: b1b77dbe-4bbf-43d6-8192-92156111d595 with Priority: HIGHEST for action port [ 1078.690775] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_rules [ 1078.690920] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 1078.692467] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1b77dbe-4bbf-43d6-8192-92156111d595 with Priority: HIGHEST for action port [ 1078.692467] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGH for action security_group_rules [ 1078.692467] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGH for action security_group_rules [ 1078.692467] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 with Priority: HIGH for action security_group_rules [ 1078.692467] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a with Priority: HIGH for action security_group_rules [ 1078.692467] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe with Priority: HIGH for action security_group_rules [ 1078.692467] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 with Priority: HIGH for action security_group_rules [ 1078.692467] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da183859-be41-4684-a134-dc3c3fac0ab7 with Priority: HIGH for action security_group_rules [ 1078.692467] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e with Priority: HIGH for action security_group_rules [ 1078.692467] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGH for action security_group_rules [ 1078.692467] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff10d50-5957-443e-a8f3-dc5ad9677624 with Priority: HIGH for action security_group_rules [ 1078.692467] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1236a1fa-0205-4a17-909f-c8686b475a69 with Priority: HIGH for action security_group_rules [ 1078.692467] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGH for action security_group_rules [ 1078.693202] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 with Priority: HIGH for action security_group_rules [ 1078.693202] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab904195-351a-49c6-8462-7f952d95cf87 with Priority: HIGH for action security_group_rules [ 1078.693202] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d with Priority: HIGH for action security_group_rules [ 1078.693202] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGH for action security_group_rules [ 1078.693202] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGH for action security_group_rules [ 1078.693202] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 with Priority: HIGH for action security_group_rules [ 1078.693202] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGH for action security_group_rules [ 1078.693202] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGH for action security_group_rules [ 1078.694574] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.694574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.694574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.694574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.694574] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.695314] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.695410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.695581] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1b77dbe-4bbf-43d6-8192-92156111d595 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.695675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1b77dbe-4bbf-43d6-8192-92156111d595" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.695735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1b77dbe-4bbf-43d6-8192-92156111d595" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.695895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1b77dbe-4bbf-43d6-8192-92156111d595" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.695964] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1b77dbe-4bbf-43d6-8192-92156111d595',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.696680] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.696786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.696849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.697074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.697120] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.698101] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26287d78-a077-45b2-9f9c-fbff1368c591 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.698101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.698101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.698289] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.698289] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26287d78-a077-45b2-9f9c-fbff1368c591',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.699601] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad77a84e-935d-4f36-9c82-e497b2b9c639 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.699601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.699601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.699601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.699601] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad77a84e-935d-4f36-9c82-e497b2b9c639',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.702546] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1db16c79-2ca0-4113-99b1-64acc68fd18a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.702712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.702826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.702998] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.703092] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1db16c79-2ca0-4113-99b1-64acc68fd18a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.703768] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f38a6b0-1f81-42d8-9f18-8deb24c569fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.703879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.703971] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.704198] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.704249] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f38a6b0-1f81-42d8-9f18-8deb24c569fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.705505] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bff14a3b-698b-4fee-8b4e-d724ef23de40 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.705505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.705505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.705505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.705505] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bff14a3b-698b-4fee-8b4e-d724ef23de40',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.706153] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da183859-be41-4684-a134-dc3c3fac0ab7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.706681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.706681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.706681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.706913] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da183859-be41-4684-a134-dc3c3fac0ab7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.707555] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb74dbe6-1fe7-4183-b9a2-aad8d748259e taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.707660] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.707724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.707940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.707940] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb74dbe6-1fe7-4183-b9a2-aad8d748259e',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.709915] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-506fca2b-4bdc-418f-be44-db369f7e1332 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.709915] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.709915] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.709915] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.709915] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('506fca2b-4bdc-418f-be44-db369f7e1332',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.710157] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fff10d50-5957-443e-a8f3-dc5ad9677624 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.710290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.710324] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.710476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.710653] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fff10d50-5957-443e-a8f3-dc5ad9677624',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.711337] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1236a1fa-0205-4a17-909f-c8686b475a69 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.711465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.711553] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.711678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.711750] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1236a1fa-0205-4a17-909f-c8686b475a69',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.712413] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.712507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.712691] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.712791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.712980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.712980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.713121] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc8c512a-6092-4e87-9d42-efdd0a8ab3f4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.714057] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab904195-351a-49c6-8462-7f952d95cf87 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.714575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.714575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.714575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.714575] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab904195-351a-49c6-8462-7f952d95cf87',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.715188] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.715268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.715349] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.715995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.715995] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ff0c3ba-5135-40b4-ae76-b08804b8ec7d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.716207] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.716294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.716388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.716496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.716570] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.717331] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.717432] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.717495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.717645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.717720] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.718454] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.718563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.718635] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.718794] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.718921] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('108f5aaf-b223-4e3b-b27d-aa7c7e251598',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.719582] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.719683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.719749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.719894] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.719964] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.720650] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.720855] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.720924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.721085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.721158] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.723055] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 in Status: SUCCESS [ 1078.723225] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 deletion is rescheduled due to dependency. [ 1078.723326] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.785047] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.222831] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1b77dbe-4bbf-43d6-8192-92156111d595 with status ACTIVE [ 1079.223176] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.223284] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.223284] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.223533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.223533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.223533] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.223533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.224053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.225292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.225292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.225292] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.225292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.225292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.225292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.225292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.225292] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1b77dbe-4bbf-43d6-8192-92156111d595 is going to be updated. [ 1079.226084] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.226142] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.226200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.226349] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.226517] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.226593] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.226633] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.227148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.227148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.227148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.227148] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.233172] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-26287d78-a077-45b2-9f9c-fbff1368c591 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.233172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.233172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.233172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.233172] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.233172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.233172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.233172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.233172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.233172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.233172] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26287d78-a077-45b2-9f9c-fbff1368c591',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.234791] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.234791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.234791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.234791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.234791] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.235392] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.235483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.235624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.235701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.235783] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.235866] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.237498] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-506fca2b-4bdc-418f-be44-db369f7e1332 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.237601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.237664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.241017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.241017] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.241017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.241017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.241017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.241017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.241017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.241017] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('506fca2b-4bdc-418f-be44-db369f7e1332',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.241017] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.241017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.241769] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.241880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.241939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.242103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.242513] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.242720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.242720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.242833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.242907] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.242986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.243091] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.257579] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.257913] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.258817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.258817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.258817] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.258817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.258817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.258817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.258817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.258817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.259415] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.289149] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.299935] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.300129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.300199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.300447] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.300578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.300735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1b77dbe-4bbf-43d6-8192-92156111d595" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.305137] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.305137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.305137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.305288] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.312414] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.312565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.313683] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.313804] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.315799] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.315901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.323993] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.323993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.337028] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.337028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.337863] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.338042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.339085] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.339191] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.339957] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.340068] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.340820] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.340920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.342963] env[69637]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1079.343496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.343624] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bff14a3b-698b-4fee-8b4e-d724ef23de40 is going to be deleted. [ 1079.344537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.344766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.362777] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.363050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.364305] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.364433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.369750] env[69637]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1079.370373] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.370507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.386897] env[69637]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1079.387506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.387692] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f38a6b0-1f81-42d8-9f18-8deb24c569fe is going to be deleted. [ 1079.388657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.388904] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.433098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.433098] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fff10d50-5957-443e-a8f3-dc5ad9677624 is going to be deleted. [ 1079.434245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.434245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.463126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.463311] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1db16c79-2ca0-4113-99b1-64acc68fd18a is going to be deleted. [ 1079.464183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.464407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.492998] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.493188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.526369] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.526369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.527101] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.527424] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.528258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.528908] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc8c512a-6092-4e87-9d42-efdd0a8ab3f4 is going to be deleted. [ 1079.529469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.529674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.576675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.576884] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab904195-351a-49c6-8462-7f952d95cf87 is going to be deleted. [ 1079.578408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.578629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.614459] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.614672] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1236a1fa-0205-4a17-909f-c8686b475a69 is going to be deleted. [ 1079.615570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.615789] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.651586] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.651748] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.672855] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.673478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.674854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.674993] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad77a84e-935d-4f36-9c82-e497b2b9c639 is going to be deleted. [ 1079.675982] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.676228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.678425] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.678425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.724036] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.724036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.727351] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 1079.727351] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac deletion is rescheduled due to dependency. [ 1079.727526] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.727689] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.727952] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.728232] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.728421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.728644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.728803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.728803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.728928] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.731369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.731537] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da183859-be41-4684-a134-dc3c3fac0ab7 is going to be deleted. [ 1079.733063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.735957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.750474] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.751509] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.751659] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.751714] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.751923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.752758] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.752758] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.752758] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.752908] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.754842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.754842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.754842] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.754842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.754842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.754842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.754842] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.754842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.754842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.754842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.754842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.754842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.754842] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.755800] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26287d78-a077-45b2-9f9c-fbff1368c591',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.755955] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.760063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.760223] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.760468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.760652] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.760811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.760811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.760987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.761183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.761183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.761337] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.761465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.761465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.761689] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.761789] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.761878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.761954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.762530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.762530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.762530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.762530] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.763463] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('506fca2b-4bdc-418f-be44-db369f7e1332',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.765531] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.765531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.773094] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.773218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.773381] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.773505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.773734] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.773811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.773811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.774018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.774105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.774192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.774336] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.774429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.774490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.774630] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.774765] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.774876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.774939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.775439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.777543] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.777543] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.777543] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.787348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.787490] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 is going to be deleted. [ 1079.789279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.789692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.799700] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.799843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.799892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.800147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.800241] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.800357] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1079.834728] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.834896] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 108f5aaf-b223-4e3b-b27d-aa7c7e251598 is going to be deleted. [ 1079.835992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.836788] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.855752] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.855924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.856890] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.857033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.857094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.857313] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.857441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.859854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.859972] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb74dbe6-1fe7-4183-b9a2-aad8d748259e is going to be deleted. [ 1079.861381] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.861598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.869150] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1079.903457] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.903590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.906227] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.906350] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ff0c3ba-5135-40b4-ae76-b08804b8ec7d is going to be deleted. [ 1079.907242] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.907453] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.907548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.907671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bff14a3b-698b-4fee-8b4e-d724ef23de40" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.907828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.907985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.908081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.908228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fff10d50-5957-443e-a8f3-dc5ad9677624" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.909049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.909222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.909304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.909454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f38a6b0-1f81-42d8-9f18-8deb24c569fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.909590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.909736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.909813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.909925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1db16c79-2ca0-4113-99b1-64acc68fd18a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.910061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.910206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.910322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.910446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab904195-351a-49c6-8462-7f952d95cf87" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.910566] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.910706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.910782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.910888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc8c512a-6092-4e87-9d42-efdd0a8ab3f4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.911022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.911156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.911230] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.911364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1236a1fa-0205-4a17-909f-c8686b475a69" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.911490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.911628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.911738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.911792] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad77a84e-935d-4f36-9c82-e497b2b9c639" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.911915] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.912067] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.912140] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.912245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da183859-be41-4684-a134-dc3c3fac0ab7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.912374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.912576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.912661] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.912770] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.960137] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.960369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.960452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.960704] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.960840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.960980] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb74dbe6-1fe7-4183-b9a2-aad8d748259e" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.961904] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.962058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.962165] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.962405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.962483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.962612] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-108f5aaf-b223-4e3b-b27d-aa7c7e251598" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.003251] env[69637]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1080.003941] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.004227] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.004298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.004585] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.004735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.004914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ff0c3ba-5135-40b4-ae76-b08804b8ec7d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.234294] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.256478] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abc9ca0b-4c93-42fd-9003-750112e8dab1: rpc.has_security_group_logging(os_id): False [ 1080.265226] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c35ee80-fc38-4bea-b273-773d4bf4b918: rpc.has_security_group_logging(os_id): False [ 1080.266466] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4dab7827-c31f-472b-b986-30803c457337: rpc.has_security_group_logging(os_id): False [ 1080.267613] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26287d78-a077-45b2-9f9c-fbff1368c591: rpc.has_security_group_logging(os_id): False [ 1080.269787] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 506fca2b-4bdc-418f-be44-db369f7e1332: rpc.has_security_group_logging(os_id): False [ 1080.279030] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 938515a1-124c-4a31-9c35-b1d93a6612b5: rpc.has_security_group_logging(os_id): False [ 1080.292728] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.292845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.293071] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.293248] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.295177] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.295321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.296108] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.296271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.297187] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.297301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.299180] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.299180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.299180] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.299180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.312545] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 1080.314022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.314239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.314454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.314726] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.314874] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.314959] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.315934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.315934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.315934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.315934] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.323108] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.323108] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.323108] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.323108] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.323108] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.323108] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.323108] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.323108] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.323108] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.323564] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.323564] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.323564] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.323564] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.323762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.323762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.323853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.323947] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 is going to be updated. [ 1080.325050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.325216] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.353399] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.354047] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.354212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.354281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.354493] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.354630] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.355503] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.355503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.355503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.355503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.355503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.355503] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.355788] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.355788] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.355788] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.355972] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.355972] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dab7827-c31f-472b-b986-30803c457337 is going to be updated. [ 1080.357023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.357192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.385137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.385461] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.385575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.385644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.386018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.386018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.386018] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26287d78-a077-45b2-9f9c-fbff1368c591 is going to be updated. [ 1080.387240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.387240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.398883] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.398883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.407618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.408093] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.408298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.408365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.408575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.408672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.408882] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.409030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.409127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.409224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.409299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.409493] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.409573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.409631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.409769] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.409844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.409954] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 is going to be updated. [ 1080.411841] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.412089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.431879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.432301] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.432384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.432459] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.432666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.432771] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.432871] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 506fca2b-4bdc-418f-be44-db369f7e1332 is going to be updated. [ 1080.434066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.434181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.434341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.435250] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.435429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.468459] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.468615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.473067] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: IN_PROGRESS for 2s [ 1080.488987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.488987] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.488987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.488987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.489348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.489770] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.489770] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 is going to be updated. [ 1080.491319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.491319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.491319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.528904] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: IN_PROGRESS for 2s [ 1080.549971] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.550135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.550883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.550883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.550883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.582764] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.582941] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.582990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.583206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.583352] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.597490] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26287d78-a077-45b2-9f9c-fbff1368c591 in Status: IN_PROGRESS for 2s [ 1080.602992] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: IN_PROGRESS for 2s [ 1080.639657] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.639813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.639861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.640106] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.640250] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.664240] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.664375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.664437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.664636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.664773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.676114] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 506fca2b-4bdc-418f-be44-db369f7e1332 in Status: IN_PROGRESS for 2s [ 1080.702600] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: IN_PROGRESS for 2s [ 1080.736154] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.818196] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.818335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.818385] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.818610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.819466] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.819589] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.819725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.819916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.820014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.820110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.820265] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.820379] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.820446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.820596] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.820738] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.820827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.820884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.821028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.821110] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.821192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.821280] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.238574] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.238761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.238833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.239017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.239106] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.239209] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 1081.265554] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.265838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.265838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.266220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.266220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.273774] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 1081.323198] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f55a00f-c3f8-407e-be41-257b4c01874f: rpc.has_security_group_logging(os_id): False [ 1081.348111] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.348111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.348111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.348111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.370315] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.371034] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.371828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.371933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.372166] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.372244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.372437] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.372553] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.372627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.372766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.372899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.373033] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.373141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.373294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.373360] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.373417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.373498] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be updated. [ 1081.438379] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.438614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.438723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.439104] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.439197] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.456981] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 1081.878548] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1081.878787] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.878955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.879196] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.879386] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.879502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.879568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.879721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.879799] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.879883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.879977] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.382910] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.383200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.383200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.383358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.383557] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.383620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.383664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.383812] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.383897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.384022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.384138] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.384231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.384291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.384433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.384576] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.384646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.384707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.384842] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.384917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.384996] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.385096] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.489485] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: SUCCESS [ 1082.489774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.544073] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: SUCCESS [ 1082.545344] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.618363] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: SUCCESS [ 1082.618363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.618685] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26287d78-a077-45b2-9f9c-fbff1368c591 in Status: SUCCESS [ 1082.618861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.636978] env[69637]: INFO networking_nsxv3.common.synchronization [req-76c3f3b8-6d41-4b50-96e0-02e42c5895e1 req-ac5ce707-71e7-4424-a686-841cfce3241d tempest-ServerAddressesNegativeTestJSON-106167820 tempest-ServerAddressesNegativeTestJSON-106167820-project-member] Enqueued Resource ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 with Priority: HIGHEST for action security_group_members [ 1082.638139] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 with Priority: HIGHEST for action security_group_members [ 1082.638139] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.639845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.639845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.639845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.639845] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.639845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.639845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.639845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.639845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.639845] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd2b09de-422b-44ae-9e68-cb7612ecfcc4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.691799] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 506fca2b-4bdc-418f-be44-db369f7e1332 in Status: SUCCESS [ 1082.691799] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.723479] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: SUCCESS [ 1082.724125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.889156] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 156f33af-1675-4f7d-b99d-9e88f58f4cd2: rpc.has_security_group_logging(os_id): False [ 1082.907618] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.907618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.907618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.907618] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.926021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.926021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.926021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.926021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.926021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.926021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.926021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.926021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.926021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.926021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.926021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.926021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.926021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.926021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.926678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.926678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.926678] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1083.005995] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.005995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.005995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.005995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.005995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.040633] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1083.143675] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.143675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.143675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.143675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.143675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.143675] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.143675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.143675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.143675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.143675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.143675] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 already deleted. [ 1083.143675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.285022] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 1083.285022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.285022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.285022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.285022] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.285022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.285022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.285022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.285022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.285022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.285022] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.351437] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-531 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.354020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-531" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.354020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-531" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.354020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-531" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.354020] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.354020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.354020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.354020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.354020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.354700] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.355160] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.355397] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.355617] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.355833] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.356127] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.356415] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.374302] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.376022] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1083.376022] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.376022] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-531" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.376022] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-32303b3d-209c-4d41-abb3-6f32a05ed205 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.376022] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-32303b3d-209c-4d41-abb3-6f32a05ed205" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.376022] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-32303b3d-209c-4d41-abb3-6f32a05ed205" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.376022] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-32303b3d-209c-4d41-abb3-6f32a05ed205" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.376565] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32303b3d-209c-4d41-abb3-6f32a05ed205',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.470024] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 1083.470024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.791025] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.791025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.791025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.791025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.791025] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.791025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.791025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.791025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.791025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.791025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.791025] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.791025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.791025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.791025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.791025] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.791025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.791868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.791868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.791868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.791868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.792214] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.882914] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.883171] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.883302] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.883594] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.883766] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.883927] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 32303b3d-209c-4d41-abb3-6f32a05ed205 not found, creating... [ 1083.884239] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.884408] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.884532] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.884858] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.884958] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.889024] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.889024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.889024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.889024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.889024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.889024] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 32303b3d-209c-4d41-abb3-6f32a05ed205 is going to be created. [ 1083.905728] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.905981] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.906125] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.906425] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.906692] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.906948] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-32303b3d-209c-4d41-abb3-6f32a05ed205" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.295669] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bac27816-ae12-436b-86da-6c4bbde7b2ac: rpc.has_security_group_logging(os_id): False [ 1084.314610] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.315128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.315128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.315321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.315450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.315749] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.315916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.316041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.316269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.317269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.317629] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.317839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.317931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.318135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.318247] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.318635] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.318749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.318895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.319130] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.319430] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.319607] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 1084.396580] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.396732] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.396805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.397027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.397176] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.411172] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 1085.059255] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1085.059574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.524441] env[69637]: INFO networking_nsxv3.common.synchronization [req-76c3f3b8-6d41-4b50-96e0-02e42c5895e1 req-4e53d4c6-662f-40da-add5-4da1daf2c036 service nova] Enqueued Resource ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 with Priority: HIGHEST for action security_group_rules [ 1085.525986] env[69637]: INFO networking_nsxv3.common.synchronization [req-76c3f3b8-6d41-4b50-96e0-02e42c5895e1 req-4e53d4c6-662f-40da-add5-4da1daf2c036 service nova] Enqueued Resource ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 with Priority: HIGHEST for action security_group_members [ 1085.526328] env[69637]: INFO networking_nsxv3.common.synchronization [req-76c3f3b8-6d41-4b50-96e0-02e42c5895e1 req-4e53d4c6-662f-40da-add5-4da1daf2c036 service nova] Enqueued Resource ID: 32303b3d-209c-4d41-abb3-6f32a05ed205 with Priority: HIGHEST for action port [ 1085.527187] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 with Priority: HIGHEST for action security_group_rules [ 1085.527480] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 with Priority: HIGHEST for action security_group_members [ 1085.527718] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32303b3d-209c-4d41-abb3-6f32a05ed205 with Priority: HIGHEST for action port [ 1085.528439] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd2b09de-422b-44ae-9e68-cb7612ecfcc4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.528733] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.531082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.531082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.531082] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd2b09de-422b-44ae-9e68-cb7612ecfcc4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.531082] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.531082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.531082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.531082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.531082] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.531082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.531082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.531082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.531082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.533922] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd2b09de-422b-44ae-9e68-cb7612ecfcc4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.535221] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-32303b3d-209c-4d41-abb3-6f32a05ed205 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.535221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32303b3d-209c-4d41-abb3-6f32a05ed205" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.535221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32303b3d-209c-4d41-abb3-6f32a05ed205" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.535433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32303b3d-209c-4d41-abb3-6f32a05ed205" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.535537] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32303b3d-209c-4d41-abb3-6f32a05ed205',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.035398] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd2b09de-422b-44ae-9e68-cb7612ecfcc4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.037919] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.038069] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.039543] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32303b3d-209c-4d41-abb3-6f32a05ed205 with status ACTIVE [ 1086.039738] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.039858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.039923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.040564] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.040564] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.040752] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.040959] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.040959] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.041119] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.041456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.041667] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.041805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.041883] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.042061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.042159] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.042239] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32303b3d-209c-4d41-abb3-6f32a05ed205 is going to be updated. [ 1086.063107] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.063473] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.063473] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.064373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.064373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.064521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32303b3d-209c-4d41-abb3-6f32a05ed205" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.428444] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 1086.428444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.428660] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.428903] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.429089] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.538834] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd2b09de-422b-44ae-9e68-cb7612ecfcc4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.936976] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.936976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.936976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.936976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.936976] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.936976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.936976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.936976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.936976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.936976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.936976] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.044245] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.044245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.044245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.044245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.044245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.044245] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 is going to be created. [ 1087.068385] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.068923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.068923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.068923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.069133] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.079639] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 in Status: UNINITIALIZED for 2s [ 1087.439504] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.439663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.439774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.440082] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.440261] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.440364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.440429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.440650] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.440720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.440773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.440914] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.441013] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.441078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.441217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.441352] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.441442] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.441511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.441633] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.441708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.441785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.441871] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.944495] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bac27816-ae12-436b-86da-6c4bbde7b2ac: rpc.has_security_group_logging(os_id): False [ 1087.963466] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.963666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.963666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.963931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.964042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.964244] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.964334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.964399] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.964553] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.964631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.964824] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.964910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.964962] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.965116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.965193] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.965387] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.965729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.965729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.965729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.965729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.965947] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 1088.060397] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.060555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.060653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.060863] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.061010] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.076668] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 1088.488209] env[69637]: INFO networking_nsxv3.common.synchronization [req-332fa4f6-4811-4af4-8470-cf39a1f50aed req-28b6e7eb-4285-4740-9c1e-debeb2d72a96 tempest-ServersTestJSON-1659168521 tempest-ServersTestJSON-1659168521-project-member] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1088.488209] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1088.488209] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.488209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.488209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.492147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.492147] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.492147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.492147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.492147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.492147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.492147] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.993632] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.089837] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 in Status: SUCCESS [ 1089.089837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.089837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.091058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.091058] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.091058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.091058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.091058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.091058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.091058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.091058] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd2b09de-422b-44ae-9e68-cb7612ecfcc4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.496434] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.596965] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.596965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.596965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.596965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.596965] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.596965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.596965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.596965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.596965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.596965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.596965] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.596965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.596965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.596965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.596965] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.596965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.597648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.597648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.597648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.597648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.597648] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd2b09de-422b-44ae-9e68-cb7612ecfcc4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.000920] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.000920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.000920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.001197] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.001197] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.001750] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1090.038636] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.038636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.038636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.040236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.040236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.049190] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1090.103872] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 1090.104207] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.104468] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd2b09de-422b-44ae-9e68-cb7612ecfcc4: rpc.has_security_group_logging(os_id): False [ 1090.125763] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.125999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.126068] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.126287] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.126409] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.126638] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.126767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.126841] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.127017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.127122] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.127321] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.127443] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.127524] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.127689] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.127799] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.128603] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.128724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.128765] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.128912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.128991] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.129094] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 is going to be created. [ 1090.193100] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.193317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.193523] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.193816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.193816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.218409] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 in Status: IN_PROGRESS for 2s [ 1092.025993] env[69637]: INFO networking_nsxv3.common.synchronization [req-45369983-dc29-4a20-90d9-5368aec481ef req-a5a47394-b609-4969-bda7-60f0e6ed2782 tempest-ServerDiskConfigTestJSON-538739594 tempest-ServerDiskConfigTestJSON-538739594-project-member] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 1092.026559] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGHEST for action security_group_members [ 1092.026873] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.026998] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.027466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.027886] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.027886] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.028020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.028059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.028426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.028426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.028527] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.072393] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1092.072636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.230319] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 in Status: SUCCESS [ 1092.230485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.534977] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.534977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.534977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.534977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.534977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.534977] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.534977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.534977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.534977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.534977] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.534977] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be updated. [ 1092.561602] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.561602] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.561602] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.561602] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.561602] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.571116] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: IN_PROGRESS for 2s [ 1092.711276] env[69637]: INFO networking_nsxv3.common.synchronization [req-fe99b146-5467-484b-8353-9851992c3f3e req-b98e4c6e-edc8-47e4-809f-30b0f45f5c16 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_members [ 1092.711791] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_members [ 1092.712199] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e078c82-40fd-4661-9911-198585d187a7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.712341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.712434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.712597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.712777] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.712953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.712953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.713145] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.713209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.713310] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.215232] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.479426] env[69637]: INFO networking_nsxv3.common.synchronization [req-7a6d807f-71a3-4425-a42e-de91e62db5b3 req-7d1841b3-207a-41d4-99a9-d714303eec3c tempest-ImagesOneServerNegativeTestJSON-1586387438 tempest-ImagesOneServerNegativeTestJSON-1586387438-project-member] Enqueued Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1093.480668] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1093.480668] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.480809] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.480809] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.481097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.481309] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.482173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.482173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.482173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.482173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.482173] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.719076] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.985204] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.985204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.985204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.985204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.985204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.985405] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.985454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.985515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.985673] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.985823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.985938] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 is going to be updated. [ 1094.016171] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.016456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.016543] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.016986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.016986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.025167] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: IN_PROGRESS for 2s [ 1094.221179] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.221499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.221499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.221621] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.221733] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.221837] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e078c82-40fd-4661-9911-198585d187a7 is going to be updated. [ 1094.265447] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.265707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.265707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.265914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.266022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.275369] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e078c82-40fd-4661-9911-198585d187a7 in Status: IN_PROGRESS for 2s [ 1094.532123] env[69637]: INFO networking_nsxv3.common.synchronization [req-d65079ba-4879-4351-885a-4525eaf3e617 req-e14de577-9064-48b9-932e-27b9335dd56d tempest-ServersTestJSON-1659168521 tempest-ServersTestJSON-1659168521-project-member] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1094.532702] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1094.532942] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.533084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.533150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.533347] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.533499] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.533594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.533654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.533856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.533983] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.534108] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.580365] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac27816-ae12-436b-86da-6c4bbde7b2ac in Status: SUCCESS [ 1094.580599] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac deletion is rescheduled due to dependency. [ 1094.580717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.036424] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.538372] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.034491] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: SUCCESS [ 1096.034708] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 deletion is rescheduled due to dependency. [ 1096.034831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.040413] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.040582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.040637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.040823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.040906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.041010] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1096.054842] env[69637]: INFO networking_nsxv3.common.synchronization [req-20edffaa-c4f0-4c6b-ad37-fc6cd6ddbd43 req-c5241625-3066-42c2-a2e0-7c0273588a3f tempest-ServerAddressesNegativeTestJSON-106167820 tempest-ServerAddressesNegativeTestJSON-106167820-project-member] Enqueued Resource ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 with Priority: HIGHEST for action security_group_members [ 1096.055392] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 with Priority: HIGHEST for action security_group_members [ 1096.055690] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.055811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.055877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.056083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.056232] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.056329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.056384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.056529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.056611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.056702] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd2b09de-422b-44ae-9e68-cb7612ecfcc4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.066100] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.066100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.066100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.066100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.066100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.074874] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1096.285804] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e078c82-40fd-4661-9911-198585d187a7 in Status: SUCCESS [ 1096.285804] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.559485] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.559858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.559858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.560128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.560336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.560582] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.560723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.560785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.560909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.560986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.561138] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 is going to be updated. [ 1096.586642] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.586642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.586642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.586856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.586926] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.594219] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 in Status: IN_PROGRESS for 2s [ 1098.087287] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1098.087287] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.604450] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 in Status: SUCCESS [ 1098.604450] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd2b09de-422b-44ae-9e68-cb7612ecfcc4 deletion is rescheduled due to dependency. [ 1098.604450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd2b09de-422b-44ae-9e68-cb7612ecfcc4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.106292] env[69637]: INFO networking_nsxv3.common.synchronization [None req-39e0ce44-7960-4ca5-a2a6-33c74e33b402 tempest-ImagesOneServerNegativeTestJSON-1586387438 tempest-ImagesOneServerNegativeTestJSON-1586387438-project-member] Enqueued Resource ID: 6c690f86-e5f5-4d57-ac05-0e0ee4b1b786 with Priority: HIGHEST for action security_group_rules [ 1100.106805] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c690f86-e5f5-4d57-ac05-0e0ee4b1b786 with Priority: HIGHEST for action security_group_rules [ 1100.107135] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c690f86-e5f5-4d57-ac05-0e0ee4b1b786 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.107249] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c690f86-e5f5-4d57-ac05-0e0ee4b1b786" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.107317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c690f86-e5f5-4d57-ac05-0e0ee4b1b786" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.107568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c690f86-e5f5-4d57-ac05-0e0ee4b1b786" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.107649] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c690f86-e5f5-4d57-ac05-0e0ee4b1b786',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.178438] env[69637]: INFO networking_nsxv3.common.synchronization [None req-303b4901-0c14-4d9a-84d8-fc2efb66fddb tempest-ImagesOneServerNegativeTestJSON-1586387438 tempest-ImagesOneServerNegativeTestJSON-1586387438-project-member] Enqueued Resource ID: 6c690f86-e5f5-4d57-ac05-0e0ee4b1b786 with Priority: HIGHEST for action security_group_rules [ 1100.179033] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c690f86-e5f5-4d57-ac05-0e0ee4b1b786 with Priority: HIGHEST for action security_group_rules [ 1100.179210] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c690f86-e5f5-4d57-ac05-0e0ee4b1b786 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.179316] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c690f86-e5f5-4d57-ac05-0e0ee4b1b786" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.633177] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.633355] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.633423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.633631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.633725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.633821] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c690f86-e5f5-4d57-ac05-0e0ee4b1b786 already deleted. [ 1100.633905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c690f86-e5f5-4d57-ac05-0e0ee4b1b786" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.634063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c690f86-e5f5-4d57-ac05-0e0ee4b1b786" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.634213] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c690f86-e5f5-4d57-ac05-0e0ee4b1b786" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.634298] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c690f86-e5f5-4d57-ac05-0e0ee4b1b786',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.644739] env[69637]: INFO networking_nsxv3.common.synchronization [req-02fb61b0-1463-45bb-a168-41e45cd087be req-a85fa16a-80db-4ff7-85c2-2b0898749d6e tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_members [ 1100.645247] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e078c82-40fd-4661-9911-198585d187a7 with Priority: HIGHEST for action security_group_members [ 1100.645630] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e078c82-40fd-4661-9911-198585d187a7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.645749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.645815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.646042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.646158] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.646308] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.646506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.646693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.647060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.647060] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e078c82-40fd-4661-9911-198585d187a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.149789] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.150034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.150077] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.150461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.153468] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.153585] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.169467] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.169732] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.169856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.169915] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.170135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.170218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.170309] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e078c82-40fd-4661-9911-198585d187a7 is going to be updated. [ 1101.171347] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.171558] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.171661] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.171753] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c690f86-e5f5-4d57-ac05-0e0ee4b1b786 already deleted. [ 1101.171880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c690f86-e5f5-4d57-ac05-0e0ee4b1b786" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.194043] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.194209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.194274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.194485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.194688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.201908] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e078c82-40fd-4661-9911-198585d187a7 in Status: IN_PROGRESS for 2s [ 1103.213059] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e078c82-40fd-4661-9911-198585d187a7 in Status: SUCCESS [ 1103.213277] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e078c82-40fd-4661-9911-198585d187a7 deletion is rescheduled due to dependency. [ 1103.213363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e078c82-40fd-4661-9911-198585d187a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.966022] env[69637]: INFO networking_nsxv3.common.synchronization [None req-3c0c5aed-bb77-4ae7-bf0f-55abf7dbfcc3 tempest-AttachInterfacesTestJSON-614004874 tempest-AttachInterfacesTestJSON-614004874-project-member] Enqueued Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 1104.966603] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f55a00f-c3f8-407e-be41-257b4c01874f with Priority: HIGHEST for action security_group_members [ 1104.966923] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f55a00f-c3f8-407e-be41-257b4c01874f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.967693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.967812] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.968074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.968267] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.968427] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.968520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.968709] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.968829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.968952] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f55a00f-c3f8-407e-be41-257b4c01874f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.474169] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.474169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.474169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.474169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.474169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.474169] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.474169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.474169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.474169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.474169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.474169] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f is going to be updated. [ 1105.499733] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.499880] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.499939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.500164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.500308] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.511208] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: IN_PROGRESS for 2s [ 1105.554563] env[69637]: INFO networking_nsxv3.common.synchronization [req-4f52908b-e1a3-45b9-9c23-4fb1268d9fec req-43b58767-a8e0-4292-849d-8a962034c8c6 tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f with Priority: HIGHEST for action security_group_members [ 1105.555357] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f with Priority: HIGHEST for action security_group_members [ 1105.558180] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.558180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.558180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.558180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.558180] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.558180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.558180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.558180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.558180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.558180] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.060918] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.061298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.061298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.061445] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.080914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.081149] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.081281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.081340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.081564] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.081652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.081742] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f is going to be updated. [ 1106.104963] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.105415] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.105561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.105789] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.105940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.114595] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f in Status: IN_PROGRESS for 2s [ 1107.520539] env[69637]: INFO networking_nsxv3.common.synchronization [None req-a0697de7-bf0a-4076-abb5-8a92bd19bf11 None None] Enqueued Resource ID: 4b3b8271-4629-4d83-94cc-936f106228ee with Priority: HIGHEST for action port [ 1107.520795] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b3b8271-4629-4d83-94cc-936f106228ee with Priority: HIGHEST for action port [ 1107.521384] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b3b8271-4629-4d83-94cc-936f106228ee taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.521493] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b3b8271-4629-4d83-94cc-936f106228ee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.521565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b3b8271-4629-4d83-94cc-936f106228ee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.521831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b3b8271-4629-4d83-94cc-936f106228ee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.521958] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b3b8271-4629-4d83-94cc-936f106228ee',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.526078] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f55a00f-c3f8-407e-be41-257b4c01874f in Status: SUCCESS [ 1107.526078] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f55a00f-c3f8-407e-be41-257b4c01874f deletion is rescheduled due to dependency. [ 1107.526078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f55a00f-c3f8-407e-be41-257b4c01874f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.862428] env[69637]: INFO networking_nsxv3.common.synchronization [req-84d23d33-fdb4-45ae-8d81-efcb438b842f req-7b885e8b-4117-4926-b413-658631779c7b tempest-ImagesOneServerNegativeTestJSON-1586387438 tempest-ImagesOneServerNegativeTestJSON-1586387438-project-member] Enqueued Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1107.863494] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1107.863494] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.863643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.863703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.865030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.865030] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.865030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.865030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.865030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.865030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.865030] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.027332] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b3b8271-4629-4d83-94cc-936f106228ee [ 1108.027674] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.027831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.027893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.028128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.028351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.028351] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b3b8271-4629-4d83-94cc-936f106228ee already deleted. [ 1108.028461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b3b8271-4629-4d83-94cc-936f106228ee" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.124211] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f in Status: SUCCESS [ 1108.126164] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f deletion is rescheduled due to dependency. [ 1108.126164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.367411] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.367411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.367411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.367411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.367411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.367411] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.367411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.367746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.367746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.367746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.367846] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 is going to be updated. [ 1108.391460] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.391611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.391685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.391896] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.392044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.401827] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: IN_PROGRESS for 2s [ 1108.503342] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-546 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.503342] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-546" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.503342] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-546" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.503342] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-546" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.503342] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.503342] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.503342] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.503342] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.503342] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.506921] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1108.507279] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1108.507636] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1108.507895] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1108.508146] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1108.508369] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1108.508613] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1108.529456] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1108.529456] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1108.529456] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1108.529456] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-546" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.529456] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-88bf4256-7eb9-4204-838a-f9a17de9c287 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.529456] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-88bf4256-7eb9-4204-838a-f9a17de9c287" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.529456] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-88bf4256-7eb9-4204-838a-f9a17de9c287" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.529456] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-88bf4256-7eb9-4204-838a-f9a17de9c287" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.529456] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88bf4256-7eb9-4204-838a-f9a17de9c287',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.031908] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.032110] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.032443] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.032510] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.032686] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.032843] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 88bf4256-7eb9-4204-838a-f9a17de9c287 not found, creating... [ 1109.033152] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.033296] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.033405] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.033595] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.033738] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.034069] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.034167] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.034282] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.034479] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.034622] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.034883] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 88bf4256-7eb9-4204-838a-f9a17de9c287 is going to be created. [ 1109.055100] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.055305] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.055444] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.055862] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.055940] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.056797] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-88bf4256-7eb9-4204-838a-f9a17de9c287" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.771259] env[69637]: INFO networking_nsxv3.common.synchronization [req-84d23d33-fdb4-45ae-8d81-efcb438b842f req-4753e4f7-9f8b-4236-a10f-9152a870780d service nova] Enqueued Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_rules [ 1109.771909] env[69637]: INFO networking_nsxv3.common.synchronization [req-84d23d33-fdb4-45ae-8d81-efcb438b842f req-4753e4f7-9f8b-4236-a10f-9152a870780d service nova] Enqueued Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1109.771909] env[69637]: INFO networking_nsxv3.common.synchronization [req-84d23d33-fdb4-45ae-8d81-efcb438b842f req-4753e4f7-9f8b-4236-a10f-9152a870780d service nova] Enqueued Resource ID: 88bf4256-7eb9-4204-838a-f9a17de9c287 with Priority: HIGHEST for action port [ 1109.772148] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_rules [ 1109.772286] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1109.772468] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bf4256-7eb9-4204-838a-f9a17de9c287 with Priority: HIGHEST for action port [ 1109.772666] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.772805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.773228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.779701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.779701] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.779701] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.779701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.779701] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-88bf4256-7eb9-4204-838a-f9a17de9c287 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.779701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88bf4256-7eb9-4204-838a-f9a17de9c287" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.779701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88bf4256-7eb9-4204-838a-f9a17de9c287" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.779701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88bf4256-7eb9-4204-838a-f9a17de9c287" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.779701] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88bf4256-7eb9-4204-838a-f9a17de9c287',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.903778] env[69637]: INFO networking_nsxv3.common.synchronization [None req-cb2c147f-757c-455a-ba8c-835a8975f7eb None None] Enqueued Resource ID: 85462fea-549b-42ea-8f49-eaef3bc8cc8c with Priority: HIGHEST for action port [ 1109.904541] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85462fea-549b-42ea-8f49-eaef3bc8cc8c with Priority: HIGHEST for action port [ 1109.904635] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-85462fea-549b-42ea-8f49-eaef3bc8cc8c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.904742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85462fea-549b-42ea-8f49-eaef3bc8cc8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.904807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85462fea-549b-42ea-8f49-eaef3bc8cc8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.905855] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85462fea-549b-42ea-8f49-eaef3bc8cc8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.905957] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85462fea-549b-42ea-8f49-eaef3bc8cc8c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.132341] env[69637]: INFO networking_nsxv3.common.synchronization [None req-bbafce6c-e884-4526-8205-fdabba6c1417 None None] Enqueued Resource ID: 32e53d5d-5605-401d-8313-cb607130f5e0 with Priority: HIGHEST for action port [ 1110.132341] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e53d5d-5605-401d-8313-cb607130f5e0 with Priority: HIGHEST for action port [ 1110.132341] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-32e53d5d-5605-401d-8313-cb607130f5e0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.132341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32e53d5d-5605-401d-8313-cb607130f5e0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.132341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32e53d5d-5605-401d-8313-cb607130f5e0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.132341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32e53d5d-5605-401d-8313-cb607130f5e0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.132341] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32e53d5d-5605-401d-8313-cb607130f5e0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.255614] env[69637]: INFO networking_nsxv3.common.synchronization [req-51c76638-f9bf-4bfe-bf37-7aac04d9f25a req-40939212-227d-4eec-bcdd-feacfbdffd9b tempest-ServersTestJSON-1659168521 tempest-ServersTestJSON-1659168521-project-member] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1110.256144] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1110.256440] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.256561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.256627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.256884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.256955] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.257569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.257655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.257829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.257919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.258299] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.281135] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.281256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.288012] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88bf4256-7eb9-4204-838a-f9a17de9c287 with status ACTIVE [ 1110.288266] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.288466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.288537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.288742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.288829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.289007] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.289111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.289174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.289315] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.289392] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.289571] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.289661] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.289720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.289855] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.289927] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.290014] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88bf4256-7eb9-4204-838a-f9a17de9c287 is going to be updated. [ 1110.310529] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.310687] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.310760] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.310959] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.311115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.311268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88bf4256-7eb9-4204-838a-f9a17de9c287" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.408764] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85462fea-549b-42ea-8f49-eaef3bc8cc8c [ 1110.408845] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.408987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.409060] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.409238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.409313] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.409609] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85462fea-549b-42ea-8f49-eaef3bc8cc8c already deleted. [ 1110.409609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85462fea-549b-42ea-8f49-eaef3bc8cc8c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.417840] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: SUCCESS [ 1110.418027] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 deletion is rescheduled due to dependency. [ 1110.421017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.421017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.421017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.421017] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.421017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.421017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.421017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.421017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.421017] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.580651] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-286 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.580943] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.581476] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.581804] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.582553] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.582553] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.582732] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.584459] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.584459] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.584459] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.584459] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.584459] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.584459] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.584459] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.584459] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.585225] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.609867] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.610050] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1110.610193] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.610391] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.610715] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-ac02b137-7534-4bb4-bb34-05d04d49468f taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.610886] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-ac02b137-7534-4bb4-bb34-05d04d49468f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.611013] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-ac02b137-7534-4bb4-bb34-05d04d49468f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.612061] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-ac02b137-7534-4bb4-bb34-05d04d49468f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.612061] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac02b137-7534-4bb4-bb34-05d04d49468f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.636648] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32e53d5d-5605-401d-8313-cb607130f5e0 [ 1110.636894] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.637107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.637107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.637291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.637379] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.637506] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32e53d5d-5605-401d-8313-cb607130f5e0 already deleted. [ 1110.637590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32e53d5d-5605-401d-8313-cb607130f5e0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.760410] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.923739] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.114828] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.115099] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.115236] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.115513] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.115697] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.115881] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port ac02b137-7534-4bb4-bb34-05d04d49468f not found, creating... [ 1111.116168] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.116330] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.116450] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.116683] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.116828] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.117139] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.117303] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.117425] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.117646] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.117785] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.117927] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: ac02b137-7534-4bb4-bb34-05d04d49468f is going to be created. [ 1111.141525] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.141793] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.141997] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.142278] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.142525] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.142861] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-ac02b137-7534-4bb4-bb34-05d04d49468f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.267075] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.431298] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.769156] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.769156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.769156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.769364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.769364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.769518] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1111.798626] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.798791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.798861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.799111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.799285] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.807714] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1111.855022] env[69637]: INFO networking_nsxv3.common.synchronization [req-51c76638-f9bf-4bfe-bf37-7aac04d9f25a req-a1a144be-8a97-4d37-abfd-a5f4e34e79e3 service nova] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_rules [ 1111.855022] env[69637]: INFO networking_nsxv3.common.synchronization [req-51c76638-f9bf-4bfe-bf37-7aac04d9f25a req-a1a144be-8a97-4d37-abfd-a5f4e34e79e3 service nova] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1111.855022] env[69637]: INFO networking_nsxv3.common.synchronization [req-51c76638-f9bf-4bfe-bf37-7aac04d9f25a req-a1a144be-8a97-4d37-abfd-a5f4e34e79e3 service nova] Enqueued Resource ID: ac02b137-7534-4bb4-bb34-05d04d49468f with Priority: HIGHEST for action port [ 1111.855022] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_rules [ 1111.855022] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1111.855022] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac02b137-7534-4bb4-bb34-05d04d49468f with Priority: HIGHEST for action port [ 1111.855567] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.855678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.855743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.855937] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.856117] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.856976] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.857108] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.857337] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac02b137-7534-4bb4-bb34-05d04d49468f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.857473] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac02b137-7534-4bb4-bb34-05d04d49468f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.857562] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac02b137-7534-4bb4-bb34-05d04d49468f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.857785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac02b137-7534-4bb4-bb34-05d04d49468f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.857884] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac02b137-7534-4bb4-bb34-05d04d49468f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.934646] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.934904] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.934904] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.935401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.935401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.935401] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 is going to be updated. [ 1111.969763] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.971143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.971293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.971756] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.972577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.980515] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: IN_PROGRESS for 2s [ 1112.363023] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.363023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.363023] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac02b137-7534-4bb4-bb34-05d04d49468f with status ACTIVE [ 1112.363023] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.363023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.363023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.363023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.363023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.363023] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.363023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.363023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.363023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.363023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.363023] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.363663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.363663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.363663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.363663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.363663] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac02b137-7534-4bb4-bb34-05d04d49468f is going to be updated. [ 1112.384957] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.385120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.385293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.385579] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.386124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.386124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac02b137-7534-4bb4-bb34-05d04d49468f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.653387] env[69637]: INFO networking_nsxv3.common.synchronization [None req-29ad2863-f0b4-4bb7-b1b0-10fb4e06ea63 None None] Enqueued Resource ID: 090dba4e-6734-47a6-af7d-e84e13557b4d with Priority: HIGHEST for action port [ 1112.654028] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 090dba4e-6734-47a6-af7d-e84e13557b4d with Priority: HIGHEST for action port [ 1112.654212] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-090dba4e-6734-47a6-af7d-e84e13557b4d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.654330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-090dba4e-6734-47a6-af7d-e84e13557b4d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.654396] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-090dba4e-6734-47a6-af7d-e84e13557b4d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.654990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-090dba4e-6734-47a6-af7d-e84e13557b4d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.654990] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('090dba4e-6734-47a6-af7d-e84e13557b4d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.157595] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 090dba4e-6734-47a6-af7d-e84e13557b4d [ 1113.158045] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.158045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.158045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.158257] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.158346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.158470] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:090dba4e-6734-47a6-af7d-e84e13557b4d already deleted. [ 1113.158576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-090dba4e-6734-47a6-af7d-e84e13557b4d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.817864] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1113.817864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.818323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.818562] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.818772] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.818927] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.819042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.819205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.819295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.819419] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.990658] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: SUCCESS [ 1113.990658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.990658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.990962] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.991033] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.991135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.991203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.991401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.991480] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.991574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.991694] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.321912] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.494516] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.494683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.494759] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.497933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.497933] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.497933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.497933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.497933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.497933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.497933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.497933] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.497933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.497933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.497933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.497933] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.497933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.497933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.497933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.497933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.497933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.497933] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.828091] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.998948] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 938515a1-124c-4a31-9c35-b1d93a6612b5: rpc.has_security_group_logging(os_id): False [ 1115.015952] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.016104] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.016177] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.016384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.016484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.016982] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.016982] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.016982] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.017152] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.017152] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.017273] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.017366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.017426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.017564] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.017658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.017845] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.017937] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.017998] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.018185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.018244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.018346] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 is going to be updated. [ 1115.075430] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.075571] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.075650] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.075841] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.076032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.088614] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: IN_PROGRESS for 2s [ 1115.331138] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.331548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.331548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.331614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.331703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.331801] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1115.359286] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.359456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.359501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.359708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.359861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.368266] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1115.520467] env[69637]: INFO networking_nsxv3.common.synchronization [req-ec5c571a-051f-475c-b367-6c5469933854 req-c89a652a-82e4-4a75-9857-92506fe104d9 tempest-ServerMetadataTestJSON-644219404 tempest-ServerMetadataTestJSON-644219404-project-member] Enqueued Resource ID: cd49e970-a2bd-4385-a944-996895a3be86 with Priority: HIGHEST for action security_group_members [ 1115.522645] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd49e970-a2bd-4385-a944-996895a3be86 with Priority: HIGHEST for action security_group_members [ 1115.522645] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd49e970-a2bd-4385-a944-996895a3be86 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.522645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.522645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.522645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.522645] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.522645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.523018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.523114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.523204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.523303] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd49e970-a2bd-4385-a944-996895a3be86',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.019020] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-816 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.019020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-816" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.019020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-816" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.019020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-816" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.019020] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.019020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.019020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.019020] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.019631] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.019995] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.020255] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.020500] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.020939] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.021234] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.021459] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.021785] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.025188] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.025468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.025637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.025934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.026239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.026902] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.026902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.026902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.027072] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.027072] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.027123] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd49e970-a2bd-4385-a944-996895a3be86 already deleted. [ 1116.027168] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.039546] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.040232] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1116.040232] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.040232] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-816" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.041637] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.041637] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.041637] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.041637] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.041637] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.544124] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.544406] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.544780] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.545049] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.545219] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.545493] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0 not found, creating... [ 1116.545810] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.545982] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.546133] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.546360] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.546504] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.546826] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.546986] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.547135] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.547357] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.547512] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.547670] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0 is going to be created. [ 1116.566421] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.566667] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.566775] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.567081] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.567336] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.567559] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.105090] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: SUCCESS [ 1117.105319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.378416] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1117.378823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.379009] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.379254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.379453] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.379572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.379636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.379784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.379866] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.379951] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.380053] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.413365] env[69637]: INFO networking_nsxv3.common.synchronization [req-ec5c571a-051f-475c-b367-6c5469933854 req-7d1ee448-ba57-4614-84f2-0fca41db06e7 service nova] Enqueued Resource ID: cd49e970-a2bd-4385-a944-996895a3be86 with Priority: HIGHEST for action security_group_rules [ 1117.413552] env[69637]: INFO networking_nsxv3.common.synchronization [req-ec5c571a-051f-475c-b367-6c5469933854 req-7d1ee448-ba57-4614-84f2-0fca41db06e7 service nova] Enqueued Resource ID: cd49e970-a2bd-4385-a944-996895a3be86 with Priority: HIGHEST for action security_group_members [ 1117.413694] env[69637]: INFO networking_nsxv3.common.synchronization [req-ec5c571a-051f-475c-b367-6c5469933854 req-7d1ee448-ba57-4614-84f2-0fca41db06e7 service nova] Enqueued Resource ID: d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0 with Priority: HIGHEST for action port [ 1117.414294] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd49e970-a2bd-4385-a944-996895a3be86 with Priority: HIGHEST for action security_group_rules [ 1117.414442] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd49e970-a2bd-4385-a944-996895a3be86 with Priority: HIGHEST for action security_group_members [ 1117.414543] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0 with Priority: HIGHEST for action port [ 1117.414815] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd49e970-a2bd-4385-a944-996895a3be86 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.414964] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.415059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.415730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.415730] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd49e970-a2bd-4385-a944-996895a3be86',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.418605] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd49e970-a2bd-4385-a944-996895a3be86 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.418605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.418605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.418605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.418605] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.418605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.418605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.418605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.418605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.418605] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd49e970-a2bd-4385-a944-996895a3be86',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.418605] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.418605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.418605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.418605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.418605] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.883132] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.883455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.883455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.883594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.883738] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.883841] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.883907] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.884099] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.884225] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.884276] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.884417] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.884506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.884564] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.884749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.884844] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.884933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.884984] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.885136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.885215] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.885296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.885403] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.921179] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd49e970-a2bd-4385-a944-996895a3be86 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.921354] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.924049] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd49e970-a2bd-4385-a944-996895a3be86',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.924856] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0 with status ACTIVE [ 1117.925058] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.925199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.925244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.925463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.925579] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.927746] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.927746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.927746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.927746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.927746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.927746] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.927746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.927746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.927746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.927746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.927746] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0 is going to be updated. [ 1117.946355] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.946686] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.946817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.947207] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.947521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.947767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d707ad1b-aa66-45e6-a5e2-a3df41ed4aa0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.392615] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 156f33af-1675-4f7d-b99d-9e88f58f4cd2: rpc.has_security_group_logging(os_id): False [ 1118.416208] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.416479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.416665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.416934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.417091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.417371] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.417491] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.417676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.417802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.417924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.418179] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.418369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.418533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.418741] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.419019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.419258] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.419410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.419508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.419712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.419838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.419964] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1118.428774] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd49e970-a2bd-4385-a944-996895a3be86',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.475945] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.477432] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.477768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.478069] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.480307] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.495218] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1118.936058] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.936058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.936058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.936058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.936536] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.936536] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd49e970-a2bd-4385-a944-996895a3be86 is going to be created. [ 1118.960837] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.960837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.960837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.960837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.961108] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.969967] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd49e970-a2bd-4385-a944-996895a3be86 in Status: UNINITIALIZED for 2s [ 1120.511689] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1120.511689] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.660228] env[69637]: INFO networking_nsxv3.common.synchronization [req-c194035c-0851-40c7-8a22-c15eaa02b9bd req-39402e2d-afd7-4123-b677-73f5606e21d3 tempest-DeleteServersTestJSON-1864882804 tempest-DeleteServersTestJSON-1864882804-project-member] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1120.660228] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1120.660228] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.660228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.660228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.660228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.660228] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.660228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.660228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.660228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.660228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.660228] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.979363] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd49e970-a2bd-4385-a944-996895a3be86 in Status: SUCCESS [ 1120.979629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.979963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.980186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.980525] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.980706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.980774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.980981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.981134] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.982271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.982466] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd49e970-a2bd-4385-a944-996895a3be86',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.030801] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.031067] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.031239] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.031686] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.034465] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.034465] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.034465] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.034465] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.034465] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.034914] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.034914] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1121.034975] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1121.035720] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1121.035720] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.035720] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1121.035883] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1121.055286] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1121.055519] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1121.055674] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1121.055882] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.056264] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-0c01380c-bfe2-40b1-99d7-7429b327a498 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.056456] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-0c01380c-bfe2-40b1-99d7-7429b327a498" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.056579] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-0c01380c-bfe2-40b1-99d7-7429b327a498" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.056897] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-0c01380c-bfe2-40b1-99d7-7429b327a498" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.057054] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c01380c-bfe2-40b1-99d7-7429b327a498',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.162228] env[69637]: INFO networking_nsxv3.common.synchronization [req-588e8aa3-d1b3-4e3d-9ba4-1557aa33b88c req-1b3845a8-c7f1-434b-9c8f-60185d34d793 tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 with Priority: HIGHEST for action security_group_members [ 1121.162863] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 with Priority: HIGHEST for action security_group_members [ 1121.163365] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.163753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.163897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.164175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.164427] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.164789] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.164789] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.164932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.165202] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.165278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.165398] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 already deleted. [ 1121.165604] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.166159] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.166265] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.166387] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.166620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.166752] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.166922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.166972] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.167137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.167242] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.167535] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5de72fa-d001-40b6-8ce0-d5b858d8f9d0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.486698] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd49e970-a2bd-4385-a944-996895a3be86 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.486850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.486946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.487189] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.487471] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.487471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.487606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.487696] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.487785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.487874] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.488097] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd49e970-a2bd-4385-a944-996895a3be86 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.488240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.488328] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.488614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.488614] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.488732] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.488766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.488988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.488988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.489094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.489146] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd49e970-a2bd-4385-a944-996895a3be86',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.560283] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.560601] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.560786] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.561388] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.561388] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.561625] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 0c01380c-bfe2-40b1-99d7-7429b327a498 not found, creating... [ 1121.561978] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.562208] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.562341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.562680] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.562877] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.563734] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.563995] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.564165] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.564400] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.564542] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.564688] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 0c01380c-bfe2-40b1-99d7-7429b327a498 is going to be created. [ 1121.584685] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.584920] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.585079] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.585480] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.585749] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.585990] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-0c01380c-bfe2-40b1-99d7-7429b327a498" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.650000] env[69637]: INFO networking_nsxv3.common.synchronization [None req-50e06929-300a-46a4-b0d7-9c0e9de9d063 tempest-ServerActionsTestJSON-2076172663 tempest-ServerActionsTestJSON-2076172663-project-member] Enqueued Resource ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 with Priority: HIGHEST for action security_group_rules [ 1121.650798] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 with Priority: HIGHEST for action security_group_rules [ 1121.651243] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-099916fa-5a16-4c59-8d82-c524401ffcf2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.651442] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.651582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.652034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.652277] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('099916fa-5a16-4c59-8d82-c524401ffcf2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.670150] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.670362] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.670436] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.670644] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.699793] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.700262] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.700461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.700512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.700782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.700971] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.701153] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 is going to be updated. [ 1121.719587] env[69637]: INFO networking_nsxv3.common.synchronization [None req-5416dc6b-e341-42ed-a044-d6f1fb339220 tempest-ServerActionsTestJSON-2076172663 tempest-ServerActionsTestJSON-2076172663-project-member] Enqueued Resource ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 with Priority: HIGHEST for action security_group_rules [ 1121.720058] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 with Priority: HIGHEST for action security_group_rules [ 1121.720396] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-099916fa-5a16-4c59-8d82-c524401ffcf2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.720520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.752298] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.752450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.752450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.753490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.753490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.763676] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 in Status: IN_PROGRESS for 2s [ 1121.993221] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd49e970-a2bd-4385-a944-996895a3be86: rpc.has_security_group_logging(os_id): False [ 1122.011224] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.011419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.011419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.011647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.011827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.011916] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.012018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.012081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.012231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.012310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.012563] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.012681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.012753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.012863] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.012937] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.013270] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.013371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.013435] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.013578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.013652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.013737] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd49e970-a2bd-4385-a944-996895a3be86 is going to be created. [ 1122.073697] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.074061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.074766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.075177] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.078419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.091341] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd49e970-a2bd-4385-a944-996895a3be86 in Status: IN_PROGRESS for 2s [ 1122.182308] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.182308] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.182308] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.182308] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.182461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.182461] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 already deleted. [ 1122.182512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.182673] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.185156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.185156] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('099916fa-5a16-4c59-8d82-c524401ffcf2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.563316] env[69637]: INFO networking_nsxv3.common.synchronization [req-c194035c-0851-40c7-8a22-c15eaa02b9bd req-aa133a01-c961-47f3-b5b4-87318d2df754 service nova] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_rules [ 1122.563547] env[69637]: INFO networking_nsxv3.common.synchronization [req-c194035c-0851-40c7-8a22-c15eaa02b9bd req-aa133a01-c961-47f3-b5b4-87318d2df754 service nova] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1122.563644] env[69637]: INFO networking_nsxv3.common.synchronization [req-c194035c-0851-40c7-8a22-c15eaa02b9bd req-aa133a01-c961-47f3-b5b4-87318d2df754 service nova] Enqueued Resource ID: 0c01380c-bfe2-40b1-99d7-7429b327a498 with Priority: HIGHEST for action port [ 1122.564155] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_rules [ 1122.564293] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1122.564395] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c01380c-bfe2-40b1-99d7-7429b327a498 with Priority: HIGHEST for action port [ 1122.564667] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.564786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.564852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.569403] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.569528] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.571444] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.572418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.572536] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.572795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.572969] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.573088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.576266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.576545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.576630] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.576741] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.579432] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c01380c-bfe2-40b1-99d7-7429b327a498 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.579563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c01380c-bfe2-40b1-99d7-7429b327a498" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.580841] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c01380c-bfe2-40b1-99d7-7429b327a498" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.580841] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c01380c-bfe2-40b1-99d7-7429b327a498" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.580841] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c01380c-bfe2-40b1-99d7-7429b327a498',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.624396] env[69637]: INFO networking_nsxv3.common.synchronization [req-1c57b826-70cf-44ee-9cc6-49b64c596e2b req-0de92c80-139a-4559-abe8-4226f71ded79 tempest-ServersTestJSON-1659168521 tempest-ServersTestJSON-1659168521-project-member] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1122.624876] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1122.625191] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.625318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.625387] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.625584] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.625732] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.625834] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.625895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.626535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.626657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.626756] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.704407] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.704791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.704882] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.705170] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.705422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.705960] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 already deleted. [ 1122.705960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.082845] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.083045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.083331] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.084311] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c01380c-bfe2-40b1-99d7-7429b327a498 with status ACTIVE [ 1123.084540] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.084678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.084747] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.084990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.085113] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.085334] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.085444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.085514] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.085694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.085784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.086075] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.086195] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.086236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.086449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.086552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.086606] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c01380c-bfe2-40b1-99d7-7429b327a498 is going to be updated. [ 1123.105808] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.106008] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.106008] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.106223] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.106359] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.106521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c01380c-bfe2-40b1-99d7-7429b327a498" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.128818] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.588808] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.631944] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.773135] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 in Status: SUCCESS [ 1123.773361] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5de72fa-d001-40b6-8ce0-d5b858d8f9d0 deletion is rescheduled due to dependency. [ 1123.773562] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5de72fa-d001-40b6-8ce0-d5b858d8f9d0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.091730] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.091730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.091730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.091986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.092057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.092263] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be created. [ 1124.119948] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd49e970-a2bd-4385-a944-996895a3be86 in Status: SUCCESS [ 1124.120558] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.127186] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.127675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.127675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.128392] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.128392] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.133988] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.134148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.134219] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.134425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.134511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.134604] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1124.137062] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: UNINITIALIZED for 2s [ 1124.184011] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.184011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.184011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.184011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.184149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.193121] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1126.146700] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: UNINITIALIZED for 4s [ 1126.201900] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1126.202102] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.017662] env[69637]: INFO networking_nsxv3.common.synchronization [req-43e19851-1ae4-4e6c-ac1e-b9f38ada56b9 req-ad22ab71-a465-4d71-96e2-233887c86d53 tempest-ServerActionsTestOtherA-1708466346 tempest-ServerActionsTestOtherA-1708466346-project-member] Enqueued Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGHEST for action security_group_members [ 1127.018249] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGHEST for action security_group_members [ 1127.018545] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-506fca2b-4bdc-418f-be44-db369f7e1332 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.018697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.018774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.018975] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.019347] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.019507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.019607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.019894] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.020043] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.020232] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('506fca2b-4bdc-418f-be44-db369f7e1332',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.522370] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.522711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.522711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.522814] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.522903] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.523159] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.523297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.523338] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.523482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.523562] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.523650] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 506fca2b-4bdc-418f-be44-db369f7e1332 is going to be updated. [ 1127.548031] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.548031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.548031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.548031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.548031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.556237] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 506fca2b-4bdc-418f-be44-db369f7e1332 in Status: IN_PROGRESS for 2s [ 1128.158432] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1128.158659] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.158825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.159052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.159273] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.162448] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.162448] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.162448] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.162448] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.162448] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.162448] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.273269] env[69637]: INFO networking_nsxv3.common.synchronization [None req-3d292540-456e-4c41-859d-29befe7aebbb tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 with Priority: HIGHEST for action security_group_rules [ 1128.273974] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 with Priority: HIGHEST for action security_group_rules [ 1128.274328] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.274528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.274528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.274776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.274862] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.351753] env[69637]: INFO networking_nsxv3.common.synchronization [None req-06bbd3e4-4f1e-48cb-b58f-de6080b81e89 tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 with Priority: HIGHEST for action security_group_rules [ 1128.352797] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 with Priority: HIGHEST for action security_group_rules [ 1128.352797] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.352797] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.665303] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.665606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.665606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.665685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.666483] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.666483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.666483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.666483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.666483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.666483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.666483] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.666725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.666725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.666786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.666891] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.666978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.667488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.667488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.667488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.667488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.667488] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.707610] env[69637]: INFO networking_nsxv3.common.synchronization [req-75bde320-1927-4af1-8c68-01674ef1185a req-aed7eae6-36ac-4c4c-9211-adfb1152a8d6 tempest-ImagesOneServerNegativeTestJSON-1586387438 tempest-ImagesOneServerNegativeTestJSON-1586387438-project-member] Enqueued Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1128.708187] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1128.708503] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.708652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.708720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.708934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.711460] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.711696] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.712521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.712674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.712808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.713398] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.795169] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.795169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.795169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.795169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.795169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.795169] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 already deleted. [ 1128.795449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.795677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.795838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.796798] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.170477] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7376d44-359d-46ab-85b9-78423d657c47: rpc.has_security_group_logging(os_id): False [ 1129.189468] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.189468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.189468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.189739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.189739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.189900] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.190279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.190381] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.190543] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.190655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.190881] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.191030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.191165] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.191342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.191440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.191655] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.191776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.191857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.192032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.192150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.192284] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be created. [ 1129.216277] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.216439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.216517] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.216725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.216813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.217020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.217134] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.217189] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.217321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.217400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.217483] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 is going to be updated. [ 1129.255224] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.255431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.255469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.255661] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.255801] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.266051] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: IN_PROGRESS for 2s [ 1129.296882] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.297065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.297150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.297365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.297561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.310133] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1129.316737] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.316876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.316952] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.317173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.317260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.317348] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 already deleted. [ 1129.317530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.568301] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 506fca2b-4bdc-418f-be44-db369f7e1332 in Status: SUCCESS [ 1129.568301] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 506fca2b-4bdc-418f-be44-db369f7e1332 deletion is rescheduled due to dependency. [ 1129.568301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.885983] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-576 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.886294] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.886438] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.886783] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.887227] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.887458] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.887625] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.887911] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.888132] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.888415] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.888666] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.888733] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.888883] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.889050] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.889214] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.889399] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.908598] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.908827] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1130.908898] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.909092] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-576" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.909419] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-a208b322-f53f-45dc-8743-d84b6780724f taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.909599] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.909722] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.909995] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.910169] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a208b322-f53f-45dc-8743-d84b6780724f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.277385] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: SUCCESS [ 1131.277736] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 deletion is rescheduled due to dependency. [ 1131.277971] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.324940] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1131.325173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.412739] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.412977] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.413123] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.413423] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.413576] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.413866] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.414037] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.414162] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.414422] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.414581] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.414871] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.415047] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.415170] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.415384] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.415523] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.415665] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: a208b322-f53f-45dc-8743-d84b6780724f is going to be updated. [ 1131.437720] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.437928] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.438090] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.438352] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.438546] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.438878] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.590250] env[69637]: INFO networking_nsxv3.common.synchronization [req-6aa51d33-a5b7-4154-b6d9-80f8c1dc94fe req-3ae11091-f0bb-44ca-8a62-429bfdee4039 tempest-ServerMetadataTestJSON-644219404 tempest-ServerMetadataTestJSON-644219404-project-member] Enqueued Resource ID: cd49e970-a2bd-4385-a944-996895a3be86 with Priority: HIGHEST for action security_group_members [ 1131.591281] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd49e970-a2bd-4385-a944-996895a3be86 with Priority: HIGHEST for action security_group_members [ 1131.591281] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd49e970-a2bd-4385-a944-996895a3be86 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.591281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.591481] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.591545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.591666] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.591767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.591830] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.591994] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.592092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.592190] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd49e970-a2bd-4385-a944-996895a3be86',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.931937] env[69637]: INFO networking_nsxv3.common.synchronization [req-24e48745-6e2b-460a-8ed8-193f93e5906b req-6db7f626-9783-4323-bc6b-e38d071ead4c tempest-ServerRescueNegativeTestJSON-1037752610 tempest-ServerRescueNegativeTestJSON-1037752610-project-member] Enqueued Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGHEST for action security_group_members [ 1131.932497] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGHEST for action security_group_members [ 1131.932804] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-26287d78-a077-45b2-9f9c-fbff1368c591 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.932944] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.932995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.933350] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.933509] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.933615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.933697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.933825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.933910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.934011] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26287d78-a077-45b2-9f9c-fbff1368c591',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.094910] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.095084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.095158] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.095377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.095467] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.095997] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.096180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.096252] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.096416] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.096500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.096587] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd49e970-a2bd-4385-a944-996895a3be86 is going to be updated. [ 1132.127328] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.127439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.127491] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.127695] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.127836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.139940] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd49e970-a2bd-4385-a944-996895a3be86 in Status: IN_PROGRESS for 2s [ 1132.436123] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.436298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.436369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.436729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.436729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.436868] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.436965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.437039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.437188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.437268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.437355] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26287d78-a077-45b2-9f9c-fbff1368c591 is going to be updated. [ 1132.458567] env[69637]: INFO networking_nsxv3.common.synchronization [req-8778dcb6-c1b8-4369-8bc6-0da918307384 req-c63c11b1-0ec1-473a-8d06-0797418b8e1e service nova] Enqueued Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_rules [ 1132.458664] env[69637]: INFO networking_nsxv3.common.synchronization [req-8778dcb6-c1b8-4369-8bc6-0da918307384 req-c63c11b1-0ec1-473a-8d06-0797418b8e1e service nova] Enqueued Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_members [ 1132.458840] env[69637]: INFO networking_nsxv3.common.synchronization [req-8778dcb6-c1b8-4369-8bc6-0da918307384 req-c63c11b1-0ec1-473a-8d06-0797418b8e1e service nova] Enqueued Resource ID: a208b322-f53f-45dc-8743-d84b6780724f with Priority: HIGHEST for action port [ 1132.459352] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_rules [ 1132.459486] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_members [ 1132.460041] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a208b322-f53f-45dc-8743-d84b6780724f with Priority: HIGHEST for action port [ 1132.460587] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.460770] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.460877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.462252] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.462252] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.462395] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.463022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.463022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.463022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.463194] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.463250] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.464195] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.464195] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.464195] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.464195] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.464745] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-a208b322-f53f-45dc-8743-d84b6780724f taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.464900] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.464999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.465231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.465361] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a208b322-f53f-45dc-8743-d84b6780724f',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.467555] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.467555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.467555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.467731] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.469620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.479194] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26287d78-a077-45b2-9f9c-fbff1368c591 in Status: IN_PROGRESS for 2s [ 1132.971033] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.971033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.971033] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a208b322-f53f-45dc-8743-d84b6780724f with status ACTIVE [ 1132.971427] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.971484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.971533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.971744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.971835] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.972017] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.972180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.972253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.972412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.972489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.972671] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.972765] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.972827] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.972963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.973050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.973134] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a208b322-f53f-45dc-8743-d84b6780724f is going to be updated. [ 1132.974184] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.006632] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.006768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.006837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.007061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.007229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.007418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a208b322-f53f-45dc-8743-d84b6780724f" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.476470] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.979105] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.979390] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.979390] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.979608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.979702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.979810] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dab7827-c31f-472b-b986-30803c457337 is going to be updated. [ 1134.006667] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.006667] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.006667] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.006914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.006944] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.016570] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: IN_PROGRESS for 2s [ 1134.149115] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd49e970-a2bd-4385-a944-996895a3be86 in Status: SUCCESS [ 1134.149363] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd49e970-a2bd-4385-a944-996895a3be86 deletion is rescheduled due to dependency. [ 1134.149522] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd49e970-a2bd-4385-a944-996895a3be86" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.489263] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26287d78-a077-45b2-9f9c-fbff1368c591 in Status: SUCCESS [ 1134.489263] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26287d78-a077-45b2-9f9c-fbff1368c591 deletion is rescheduled due to dependency. [ 1134.489263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.156663] env[69637]: INFO networking_nsxv3.common.synchronization [req-bdf3368b-6841-45c0-8e50-7981f9212a77 req-7620dcef-179f-4208-8b46-fe112e4e1105 tempest-DeleteServersTestJSON-1864882804 tempest-DeleteServersTestJSON-1864882804-project-member] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1135.157294] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1135.158032] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.158032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.158265] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.158776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.158776] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.158776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.158954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.159051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.159185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.159254] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.663703] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.663887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.663933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.664205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.664308] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.664503] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.664620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.664651] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.664803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.664876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.664976] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1135.689519] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.689670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.689740] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.689948] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.690125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.698628] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1136.025240] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: SUCCESS [ 1136.025501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.025668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.025889] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.026102] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.026223] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.026287] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.026449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.026532] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.026617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.026708] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.467629] env[69637]: INFO networking_nsxv3.common.synchronization [req-82a6367b-0872-499d-9fca-52dc3746fdd9 req-96a3305e-a824-4fda-9c9a-b3971275eb16 tempest-ServerActionsTestJSON-2076172663 tempest-ServerActionsTestJSON-2076172663-project-member] Enqueued Resource ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 with Priority: HIGHEST for action security_group_members [ 1136.468300] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 with Priority: HIGHEST for action security_group_members [ 1136.468617] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-099916fa-5a16-4c59-8d82-c524401ffcf2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.468743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.468811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.469299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.469430] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.469545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.469613] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.469786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.469868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.469963] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('099916fa-5a16-4c59-8d82-c524401ffcf2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.529442] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.529659] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.529768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.530101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.530361] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.530524] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.530640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.530878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.531015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.531175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.531418] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.531563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.531670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.531903] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.532134] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.532294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.532402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.532671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.532729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.532855] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.533010] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.803051] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-970 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.803051] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.803279] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.803536] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.803930] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.804164] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.804370] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.804781] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.805039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.805320] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.805528] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.805741] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.805876] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.806059] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.806216] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.806381] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.826654] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.826899] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1136.827067] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.827252] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.827672] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-a99e47fa-a629-4c81-bac0-c2768c4e932a taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.827859] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-a99e47fa-a629-4c81-bac0-c2768c4e932a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.828024] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-a99e47fa-a629-4c81-bac0-c2768c4e932a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.828415] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-a99e47fa-a629-4c81-bac0-c2768c4e932a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.828571] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a99e47fa-a629-4c81-bac0-c2768c4e932a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.971841] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.972093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.972093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.972323] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.972425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.972619] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.972737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.972799] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.972929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.973019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.973098] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 already deleted. [ 1136.973179] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.035857] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4dab7827-c31f-472b-b986-30803c457337: rpc.has_security_group_logging(os_id): False [ 1137.054297] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.054538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.054538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.054787] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.054892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.055137] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.055238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.055370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.055453] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.056047] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.056047] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.056047] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.056047] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.056331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.056331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.056392] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.056474] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.056556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.056755] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.056787] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.056874] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dab7827-c31f-472b-b986-30803c457337 is going to be updated. [ 1137.113757] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.113981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.114077] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.114366] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.115026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.129063] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: IN_PROGRESS for 2s [ 1137.330771] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.330977] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.331105] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.331497] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.331631] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.331798] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port a99e47fa-a629-4c81-bac0-c2768c4e932a not found, creating... [ 1137.333484] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.333655] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.333795] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.334018] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.334166] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.334522] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.334702] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.334819] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.335053] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.335197] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.335342] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: a99e47fa-a629-4c81-bac0-c2768c4e932a is going to be created. [ 1137.354150] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.354405] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.354494] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.354781] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.354997] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.355261] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-a99e47fa-a629-4c81-bac0-c2768c4e932a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.708584] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1137.709057] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 deletion is rescheduled due to dependency. [ 1137.709057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.090756] env[69637]: INFO networking_nsxv3.common.synchronization [req-82a6367b-0872-499d-9fca-52dc3746fdd9 req-33c292d3-134f-45a8-9f0d-dcbf2027a627 service nova] Enqueued Resource ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 with Priority: HIGHEST for action security_group_rules [ 1138.090941] env[69637]: INFO networking_nsxv3.common.synchronization [req-82a6367b-0872-499d-9fca-52dc3746fdd9 req-33c292d3-134f-45a8-9f0d-dcbf2027a627 service nova] Enqueued Resource ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 with Priority: HIGHEST for action security_group_members [ 1138.091126] env[69637]: INFO networking_nsxv3.common.synchronization [req-82a6367b-0872-499d-9fca-52dc3746fdd9 req-33c292d3-134f-45a8-9f0d-dcbf2027a627 service nova] Enqueued Resource ID: a99e47fa-a629-4c81-bac0-c2768c4e932a with Priority: HIGHEST for action port [ 1138.091376] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 with Priority: HIGHEST for action security_group_rules [ 1138.091509] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 with Priority: HIGHEST for action security_group_members [ 1138.091607] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99e47fa-a629-4c81-bac0-c2768c4e932a with Priority: HIGHEST for action port [ 1138.093056] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-099916fa-5a16-4c59-8d82-c524401ffcf2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.093394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.093526] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.094492] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.094649] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('099916fa-5a16-4c59-8d82-c524401ffcf2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.095764] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-099916fa-5a16-4c59-8d82-c524401ffcf2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.095957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.096051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.096306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.096504] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.096684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.096768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.096974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.097105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.097236] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('099916fa-5a16-4c59-8d82-c524401ffcf2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.098195] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-a99e47fa-a629-4c81-bac0-c2768c4e932a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.098346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a99e47fa-a629-4c81-bac0-c2768c4e932a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.098446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a99e47fa-a629-4c81-bac0-c2768c4e932a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.098690] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a99e47fa-a629-4c81-bac0-c2768c4e932a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.098799] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a99e47fa-a629-4c81-bac0-c2768c4e932a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.601319] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-099916fa-5a16-4c59-8d82-c524401ffcf2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.601526] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.601676] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('099916fa-5a16-4c59-8d82-c524401ffcf2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.602573] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a99e47fa-a629-4c81-bac0-c2768c4e932a with status ACTIVE [ 1138.602747] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.602877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.602945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.603151] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.603250] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.603416] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.603514] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.603568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.603713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.603783] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.603963] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.604330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.604413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.604585] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.604660] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.604746] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a99e47fa-a629-4c81-bac0-c2768c4e932a is going to be updated. [ 1138.624526] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.624684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.624753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.624968] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.625179] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.625282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a99e47fa-a629-4c81-bac0-c2768c4e932a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.107651] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('099916fa-5a16-4c59-8d82-c524401ffcf2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.143540] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: SUCCESS [ 1139.143715] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.610039] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.610254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.610254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.610487] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.610580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.610681] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 is going to be created. [ 1139.632089] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.632302] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.632302] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.632642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.632899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.642445] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 in Status: UNINITIALIZED for 2s [ 1141.653298] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 in Status: SUCCESS [ 1141.653581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.653701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.653926] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.654138] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.654260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.654325] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.654472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.654551] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.654640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.654728] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('099916fa-5a16-4c59-8d82-c524401ffcf2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.157972] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('099916fa-5a16-4c59-8d82-c524401ffcf2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.415597] env[69637]: INFO networking_nsxv3.common.synchronization [req-49f9e2cc-8d7c-4221-b089-912b3a16db13 req-5458d24b-8385-4f7c-b042-b907303069af tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 with Priority: HIGHEST for action security_group_members [ 1142.416182] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 with Priority: HIGHEST for action security_group_members [ 1142.416473] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.416603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.416668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.416932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.418563] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.418744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.419017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.419254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.421495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.421495] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.659526] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 099916fa-5a16-4c59-8d82-c524401ffcf2: rpc.has_security_group_logging(os_id): False [ 1142.676286] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.676434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.676510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.676753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.676848] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.677112] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.677555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.677555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.677555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.677555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.677771] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 is going to be created. [ 1142.730186] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.730418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.730528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.730775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.730965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.735127] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-19 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.735325] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.735452] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.735717] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.735991] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.736168] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.736306] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.736532] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.736678] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.736892] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1142.737018] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1142.737132] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1142.737247] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1142.737358] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1142.737472] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1142.737611] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1142.741757] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 in Status: IN_PROGRESS for 2s [ 1142.757575] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1142.757723] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1142.757870] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1142.758106] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.758436] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-646f58e9-63f2-4e62-8e89-e11d63f64b9c taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.758615] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-646f58e9-63f2-4e62-8e89-e11d63f64b9c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.758735] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-646f58e9-63f2-4e62-8e89-e11d63f64b9c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.759086] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-646f58e9-63f2-4e62-8e89-e11d63f64b9c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.759232] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('646f58e9-63f2-4e62-8e89-e11d63f64b9c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.924330] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.924330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.924330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.924628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.924628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.924691] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.924795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.924866] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.925022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.925100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.925187] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 already deleted. [ 1142.925270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.261759] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.261759] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.261974] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.263142] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.263142] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.263142] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 646f58e9-63f2-4e62-8e89-e11d63f64b9c not found, creating... [ 1143.263142] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.263142] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.263142] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.263447] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.263447] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.263731] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.263893] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.264235] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.264469] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.264611] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.264758] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 646f58e9-63f2-4e62-8e89-e11d63f64b9c is going to be created. [ 1143.286305] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.286532] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.286661] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.286946] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.287213] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.287450] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-646f58e9-63f2-4e62-8e89-e11d63f64b9c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.218022] env[69637]: INFO networking_nsxv3.common.synchronization [req-49f9e2cc-8d7c-4221-b089-912b3a16db13 req-bc787455-94cb-4c62-8cda-67daab9d3bf5 service nova] Enqueued Resource ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 with Priority: HIGHEST for action security_group_rules [ 1144.218022] env[69637]: INFO networking_nsxv3.common.synchronization [req-49f9e2cc-8d7c-4221-b089-912b3a16db13 req-bc787455-94cb-4c62-8cda-67daab9d3bf5 service nova] Enqueued Resource ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 with Priority: HIGHEST for action security_group_members [ 1144.218022] env[69637]: INFO networking_nsxv3.common.synchronization [req-49f9e2cc-8d7c-4221-b089-912b3a16db13 req-bc787455-94cb-4c62-8cda-67daab9d3bf5 service nova] Enqueued Resource ID: 646f58e9-63f2-4e62-8e89-e11d63f64b9c with Priority: HIGHEST for action port [ 1144.218477] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 with Priority: HIGHEST for action security_group_rules [ 1144.218614] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 with Priority: HIGHEST for action security_group_members [ 1144.218714] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 646f58e9-63f2-4e62-8e89-e11d63f64b9c with Priority: HIGHEST for action port [ 1144.218999] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.219231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.219231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.219368] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.219453] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.220394] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.220477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.220509] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.222932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.222932] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.222932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.222932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.222932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.222932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.222932] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.222932] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-646f58e9-63f2-4e62-8e89-e11d63f64b9c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.222932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-646f58e9-63f2-4e62-8e89-e11d63f64b9c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.222932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-646f58e9-63f2-4e62-8e89-e11d63f64b9c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.222932] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-646f58e9-63f2-4e62-8e89-e11d63f64b9c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.222932] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('646f58e9-63f2-4e62-8e89-e11d63f64b9c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.724111] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.724296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.725672] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.727360] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 646f58e9-63f2-4e62-8e89-e11d63f64b9c with status ACTIVE [ 1144.727548] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.727668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.727731] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.728087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.728200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.728397] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.728495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.728556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.728720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.728794] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.728977] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.729075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.729160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.729831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.729831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.729831] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 646f58e9-63f2-4e62-8e89-e11d63f64b9c is going to be updated. [ 1144.750182] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.750317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.750377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.750571] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.750697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.750840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-646f58e9-63f2-4e62-8e89-e11d63f64b9c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.753881] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 in Status: SUCCESS [ 1144.753881] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.231724] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.734332] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.734503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.734575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.734797] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.734888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.734986] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 is going to be created. [ 1145.762693] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.762855] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.762906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.763148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.763335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.773083] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 in Status: UNINITIALIZED for 2s [ 1147.784355] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 in Status: SUCCESS [ 1147.784710] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.784850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.785085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.785295] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.785419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.785458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.785594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.785678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.785763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.785857] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.288401] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.790592] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2: rpc.has_security_group_logging(os_id): False [ 1148.808422] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.808611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.808657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.808845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.808933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.809265] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.809375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.809531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.809584] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.809666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.809751] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 is going to be created. [ 1148.862857] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.863036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.863077] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.863284] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.863465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.873018] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 in Status: IN_PROGRESS for 2s [ 1149.220218] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1149.220319] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1149.381619] env[69637]: INFO networking_nsxv3.common.synchronization [req-c83e450a-1463-4ee1-998a-d63f0505252e req-cf00cce0-4d33-47f5-8341-d33d92a99e06 tempest-ServersTestJSON-1659168521 tempest-ServersTestJSON-1659168521-project-member] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1149.382376] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1149.382699] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.382825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.382891] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.383104] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.383254] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.383351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.383421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.383551] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.383722] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.383722] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.736204] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-286 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.736585] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.736682] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.737077] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.737698] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.737698] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.737846] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.738447] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.738447] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.738719] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1149.738899] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1149.739074] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1149.739238] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1149.739404] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1149.739576] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1149.739765] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1149.758257] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1149.758494] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1149.758554] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1149.758732] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-286" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.759082] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-19932282-d169-4706-a328-c93e80a1b8d2 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.759260] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-19932282-d169-4706-a328-c93e80a1b8d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.759380] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-19932282-d169-4706-a328-c93e80a1b8d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.759709] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-19932282-d169-4706-a328-c93e80a1b8d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.759851] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19932282-d169-4706-a328-c93e80a1b8d2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.887343] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.262524] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.262774] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.262913] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.263239] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.263389] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.263561] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 19932282-d169-4706-a328-c93e80a1b8d2 not found, creating... [ 1150.263844] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.264019] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.264152] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.264395] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.264537] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.264841] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.265059] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.265149] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.265357] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.265516] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.265667] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 19932282-d169-4706-a328-c93e80a1b8d2 is going to be created. [ 1150.284670] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.284892] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.285044] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.285426] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.285631] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.285856] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-19932282-d169-4706-a328-c93e80a1b8d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.389741] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.884380] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 in Status: SUCCESS [ 1150.884610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.892215] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.892568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.892568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.892691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.892775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.892869] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1150.916965] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.917137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.917185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.917402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.917547] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.926127] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1151.011901] env[69637]: INFO networking_nsxv3.common.synchronization [req-c83e450a-1463-4ee1-998a-d63f0505252e req-716dcd27-bc22-4a8a-b445-fad625dc77e8 service nova] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_rules [ 1151.012135] env[69637]: INFO networking_nsxv3.common.synchronization [req-c83e450a-1463-4ee1-998a-d63f0505252e req-716dcd27-bc22-4a8a-b445-fad625dc77e8 service nova] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1151.012292] env[69637]: INFO networking_nsxv3.common.synchronization [req-c83e450a-1463-4ee1-998a-d63f0505252e req-716dcd27-bc22-4a8a-b445-fad625dc77e8 service nova] Enqueued Resource ID: 19932282-d169-4706-a328-c93e80a1b8d2 with Priority: HIGHEST for action port [ 1151.012524] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_rules [ 1151.012676] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1151.012784] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19932282-d169-4706-a328-c93e80a1b8d2 with Priority: HIGHEST for action port [ 1151.013372] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.013464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.013533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.013730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.013809] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.014658] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.014761] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.014954] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-19932282-d169-4706-a328-c93e80a1b8d2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.015064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19932282-d169-4706-a328-c93e80a1b8d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.015124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19932282-d169-4706-a328-c93e80a1b8d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.015293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19932282-d169-4706-a328-c93e80a1b8d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.015363] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19932282-d169-4706-a328-c93e80a1b8d2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.517915] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.518113] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.518355] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19932282-d169-4706-a328-c93e80a1b8d2 with status ACTIVE [ 1151.518542] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.518666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.519014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.519014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.519160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.519345] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.519461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.519535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.519708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.519788] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.520044] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.520151] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.520209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.520349] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.520422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.520501] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19932282-d169-4706-a328-c93e80a1b8d2 is going to be updated. [ 1151.539787] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.540092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.540092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.540773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.540773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.540773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19932282-d169-4706-a328-c93e80a1b8d2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.936305] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1152.936765] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.936765] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.937112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.937336] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.937414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.937464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.937662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.937711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.937778] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.440117] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.499964] env[69637]: INFO networking_nsxv3.common.synchronization [req-f2f8aaf5-9c2d-47f1-aafa-d852c5997e55 req-ab514184-c1af-4ee9-9903-7b847f131558 tempest-ServerActionsTestOtherA-1708466346 tempest-ServerActionsTestOtherA-1708466346-project-member] Enqueued Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_members [ 1153.504034] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_members [ 1153.504034] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.504034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.504034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.504034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.504034] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.504034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.504034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.504034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.504034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.504034] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.916163] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-310 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.916163] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.916163] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.916163] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.916163] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.916163] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.916163] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.916163] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.916960] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.917324] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.917547] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1153.917821] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1153.918026] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1153.918254] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.918455] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1153.918716] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1153.937080] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1153.940097] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1153.940097] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1153.940097] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.940097] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-d5aa788d-02ef-4dec-8c61-0a0011725217 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.940097] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-d5aa788d-02ef-4dec-8c61-0a0011725217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.940097] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-d5aa788d-02ef-4dec-8c61-0a0011725217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.940097] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-d5aa788d-02ef-4dec-8c61-0a0011725217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.940097] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5aa788d-02ef-4dec-8c61-0a0011725217',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.942679] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.003899] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.004181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.004317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.004655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.004811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.005422] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.005422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.005422] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.005674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.005820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.005978] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 is going to be deleted. [ 1154.032933] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.033164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.033275] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.033596] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.033737] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.033890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.156019] env[69637]: INFO networking_nsxv3.common.synchronization [req-759ffe73-8c5f-4d8e-945e-fe59c6902880 req-5308e076-4ab3-4e81-a46f-fd0ffe1b73a5 tempest-ServerRescueNegativeTestJSON-1037752610 tempest-ServerRescueNegativeTestJSON-1037752610-project-member] Enqueued Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_members [ 1154.156637] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_members [ 1154.156953] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.157115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.157207] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.157502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.157671] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.158140] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.158140] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.158140] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.158140] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.158281] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.443071] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.443071] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.443071] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.443400] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.443517] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.443684] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port d5aa788d-02ef-4dec-8c61-0a0011725217 not found, creating... [ 1154.444051] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.444207] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.444331] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.444639] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.444810] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.445191] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.445387] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.445541] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.445812] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.445982] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.446187] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: d5aa788d-02ef-4dec-8c61-0a0011725217 is going to be created. [ 1154.447851] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.448034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.448136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.448329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.448415] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.448527] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1154.470166] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.470434] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.470625] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.470891] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.471186] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.471459] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-d5aa788d-02ef-4dec-8c61-0a0011725217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.478625] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.478800] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.478841] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.479017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.479173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.487299] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1154.664249] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.166388] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.361074] env[69637]: INFO networking_nsxv3.common.synchronization [req-f2f8aaf5-9c2d-47f1-aafa-d852c5997e55 req-641bb9b8-5f0d-4f54-8827-00866f57418a service nova] Enqueued Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_rules [ 1155.361315] env[69637]: INFO networking_nsxv3.common.synchronization [req-f2f8aaf5-9c2d-47f1-aafa-d852c5997e55 req-641bb9b8-5f0d-4f54-8827-00866f57418a service nova] Enqueued Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_members [ 1155.361487] env[69637]: INFO networking_nsxv3.common.synchronization [req-f2f8aaf5-9c2d-47f1-aafa-d852c5997e55 req-641bb9b8-5f0d-4f54-8827-00866f57418a service nova] Enqueued Resource ID: d5aa788d-02ef-4dec-8c61-0a0011725217 with Priority: HIGHEST for action port [ 1155.362413] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_rules [ 1155.362561] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_members [ 1155.362656] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5aa788d-02ef-4dec-8c61-0a0011725217 with Priority: HIGHEST for action port [ 1155.362945] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.363134] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.363244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.363634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.363634] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.364560] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.364678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.364775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.364955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.365135] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.365280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.365345] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.365539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.365640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.365752] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.367378] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5aa788d-02ef-4dec-8c61-0a0011725217 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.367660] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5aa788d-02ef-4dec-8c61-0a0011725217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.367725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5aa788d-02ef-4dec-8c61-0a0011725217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.367903] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5aa788d-02ef-4dec-8c61-0a0011725217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.368122] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5aa788d-02ef-4dec-8c61-0a0011725217',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.669120] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.669284] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.669372] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.669571] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.669659] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.669753] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 is going to be updated. [ 1155.697804] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.698149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.698149] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.698297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.698505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.706484] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: IN_PROGRESS for 2s [ 1155.870531] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.870682] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.870913] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.871919] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5aa788d-02ef-4dec-8c61-0a0011725217 with status ACTIVE [ 1155.872122] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.872279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.872378] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.872606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.872698] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.872874] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.872994] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.876229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.876440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.876583] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.876949] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.876949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.876949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.877133] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.877250] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.877362] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5aa788d-02ef-4dec-8c61-0a0011725217 is going to be updated. [ 1155.897041] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.897183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.897258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.897469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.897603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.897790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5aa788d-02ef-4dec-8c61-0a0011725217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.112289] env[69637]: INFO networking_nsxv3.common.synchronization [req-2f188394-b337-4425-bff0-0c8297b10df5 req-76207e9a-3095-4810-b477-271865318fe3 tempest-ImagesOneServerNegativeTestJSON-1586387438 tempest-ImagesOneServerNegativeTestJSON-1586387438-project-member] Enqueued Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1156.112824] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1156.113138] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.114413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.114413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.114493] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.117024] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.117024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.117024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.117024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.117024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.117024] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.380611] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.451616] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-546 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.451809] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-546" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.451930] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-546" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.452211] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-546" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.452461] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.452612] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.452724] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.452934] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.453224] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.453449] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.453608] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.453682] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.453760] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.453866] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.453977] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.454173] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1156.473893] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1156.473893] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1156.473893] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1156.473991] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-546" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.474380] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-58f25bff-7b5a-4957-a356-c6b9d7689301 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.474553] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-58f25bff-7b5a-4957-a356-c6b9d7689301" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.474670] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-58f25bff-7b5a-4957-a356-c6b9d7689301" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.474977] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-58f25bff-7b5a-4957-a356-c6b9d7689301" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.475130] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58f25bff-7b5a-4957-a356-c6b9d7689301',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.496482] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1156.497114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.497114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.497302] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.497517] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.497588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.497652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.497853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.497945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.497987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.498066] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.618998] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.619205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.619301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.619556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.619669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.619904] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.620076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.620173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.620346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.620447] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.620558] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 is going to be updated. [ 1156.643180] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.643354] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.643425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.643660] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.643825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.651312] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: IN_PROGRESS for 2s [ 1156.882462] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.882622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.882656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.882850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.882933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.883053] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 is going to be created. [ 1156.909433] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.909590] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.909640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.909851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.910046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.919161] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 in Status: UNINITIALIZED for 2s [ 1156.979103] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.979379] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.979898] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.979898] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.980140] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.980607] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 58f25bff-7b5a-4957-a356-c6b9d7689301 not found, creating... [ 1156.980986] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.980986] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.981182] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.981443] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.981649] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.981997] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.982236] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.982386] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.982880] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.982880] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.982998] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 58f25bff-7b5a-4957-a356-c6b9d7689301 is going to be created. [ 1157.000851] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.001078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.001168] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.001383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.001557] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.001656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.001719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.001864] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.001947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.002078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.002213] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.002305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.002367] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.002508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.002646] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.002735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.002794] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.002929] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.003010] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.003096] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.003185] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.010071] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.010320] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.010497] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.010753] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.010985] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.011426] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-58f25bff-7b5a-4957-a356-c6b9d7689301" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.506147] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 156f33af-1675-4f7d-b99d-9e88f58f4cd2: rpc.has_security_group_logging(os_id): False [ 1157.529158] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.529318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.529390] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.529601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.529689] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.529891] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.530023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.530092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.530251] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.530332] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.530531] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.530746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.530746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.531181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.531181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.531181] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.531300] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.531300] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.531407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.531479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.531562] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1157.586110] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.586269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.586340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.586546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.586690] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.600126] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1157.716641] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: SUCCESS [ 1157.716919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.739892] env[69637]: INFO networking_nsxv3.common.synchronization [req-2f188394-b337-4425-bff0-0c8297b10df5 req-96922f5a-6a0b-43f9-be86-25a970a4977f service nova] Enqueued Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_rules [ 1157.740172] env[69637]: INFO networking_nsxv3.common.synchronization [req-2f188394-b337-4425-bff0-0c8297b10df5 req-96922f5a-6a0b-43f9-be86-25a970a4977f service nova] Enqueued Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1157.740314] env[69637]: INFO networking_nsxv3.common.synchronization [req-2f188394-b337-4425-bff0-0c8297b10df5 req-96922f5a-6a0b-43f9-be86-25a970a4977f service nova] Enqueued Resource ID: 58f25bff-7b5a-4957-a356-c6b9d7689301 with Priority: HIGHEST for action port [ 1157.740807] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_rules [ 1157.740939] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1157.741066] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58f25bff-7b5a-4957-a356-c6b9d7689301 with Priority: HIGHEST for action port [ 1157.741389] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.741451] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.741517] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.741721] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.741788] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.742644] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.742727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.742893] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-58f25bff-7b5a-4957-a356-c6b9d7689301 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.742990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58f25bff-7b5a-4957-a356-c6b9d7689301" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.743065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58f25bff-7b5a-4957-a356-c6b9d7689301" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.743233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58f25bff-7b5a-4957-a356-c6b9d7689301" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.743302] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58f25bff-7b5a-4957-a356-c6b9d7689301',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.154025] env[69637]: INFO networking_nsxv3.common.synchronization [req-8bf822c0-099f-4281-b43d-9611450be32e req-ac62d94a-d7c8-48fd-99f3-4adf321b09b6 tempest-DeleteServersTestJSON-1864882804 tempest-DeleteServersTestJSON-1864882804-project-member] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1158.154548] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1158.155033] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.155033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.155033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.155241] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.155387] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.155482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.155545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.155685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.155767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.156016] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.245389] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.245580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.245685] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58f25bff-7b5a-4957-a356-c6b9d7689301 with status ACTIVE [ 1158.245854] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.245955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.246029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.246237] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.246341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.246521] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.246648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.246709] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.246841] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.246920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.247113] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.247226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.247291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.247391] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.247461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.247544] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58f25bff-7b5a-4957-a356-c6b9d7689301 is going to be updated. [ 1158.275802] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.276042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.276042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.276122] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.276267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.276429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58f25bff-7b5a-4957-a356-c6b9d7689301" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.437114] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.437482] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.437709] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.438157] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.438791] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.439112] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.439489] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.439803] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.440162] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.440489] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.440651] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1158.440860] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1158.441119] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1158.441289] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.441452] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1158.441626] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1158.464091] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1158.464308] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1158.464511] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1158.464600] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.464919] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-704ea890-c37c-4b1e-a651-14860c7dba44 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.465112] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-704ea890-c37c-4b1e-a651-14860c7dba44" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.465236] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-704ea890-c37c-4b1e-a651-14860c7dba44" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.465550] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-704ea890-c37c-4b1e-a651-14860c7dba44" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.465692] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('704ea890-c37c-4b1e-a651-14860c7dba44',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.658836] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.658836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.658836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.659345] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.659345] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.659486] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.659607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.659671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.659828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.659950] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.660043] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1158.661819] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: SUCCESS [ 1158.661989] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 deletion is rescheduled due to dependency. [ 1158.662105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.662265] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.662434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.662605] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.662707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.662773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.662918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.663072] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.663128] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.686939] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.687129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.687177] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.687350] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.687483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.696333] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1158.928487] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 in Status: SUCCESS [ 1158.928487] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.928712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.928839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.929035] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.929146] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.929217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.929579] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.929579] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.929579] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.929579] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.968524] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.968782] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.968878] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.969272] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.969438] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.969596] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 704ea890-c37c-4b1e-a651-14860c7dba44 not found, creating... [ 1158.969863] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.970071] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.970183] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.970414] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.970556] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.970852] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.971016] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.971171] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.971383] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.971521] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.971665] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 704ea890-c37c-4b1e-a651-14860c7dba44 is going to be created. [ 1158.988682] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.988860] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.988985] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.989232] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.989455] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.989665] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-704ea890-c37c-4b1e-a651-14860c7dba44" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.165432] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.431530] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.431684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.431771] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.432134] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.432225] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.432329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.432329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.432546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.432546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.432659] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.432797] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.432869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.432933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.433091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.433242] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.433336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.433400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.433531] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.433602] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.433706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.433848] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.615103] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1159.615341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.667943] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.878877] env[69637]: INFO networking_nsxv3.common.synchronization [req-8bf822c0-099f-4281-b43d-9611450be32e req-40b0835f-aad2-40b3-944e-7dc5405cdc2d service nova] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_rules [ 1159.878877] env[69637]: INFO networking_nsxv3.common.synchronization [req-8bf822c0-099f-4281-b43d-9611450be32e req-40b0835f-aad2-40b3-944e-7dc5405cdc2d service nova] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1159.878877] env[69637]: INFO networking_nsxv3.common.synchronization [req-8bf822c0-099f-4281-b43d-9611450be32e req-40b0835f-aad2-40b3-944e-7dc5405cdc2d service nova] Enqueued Resource ID: 704ea890-c37c-4b1e-a651-14860c7dba44 with Priority: HIGHEST for action port [ 1159.879689] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_rules [ 1159.879879] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1159.880024] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704ea890-c37c-4b1e-a651-14860c7dba44 with Priority: HIGHEST for action port [ 1159.880349] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.880443] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.880512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.880797] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.880951] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.885552] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.885678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.885901] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-704ea890-c37c-4b1e-a651-14860c7dba44 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.886009] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-704ea890-c37c-4b1e-a651-14860c7dba44" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.886096] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-704ea890-c37c-4b1e-a651-14860c7dba44" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.886293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-704ea890-c37c-4b1e-a651-14860c7dba44" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.886344] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('704ea890-c37c-4b1e-a651-14860c7dba44',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.936619] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b978e6a-7c34-4af8-a48f-77dd3db23234: rpc.has_security_group_logging(os_id): False [ 1159.954366] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.954519] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.954592] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.954865] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.954966] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.955210] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.955312] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.955377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.955528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.955605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.955776] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.955868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.955931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.956123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.956227] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.956388] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.956479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.956541] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.956678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.956751] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.956837] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 is going to be created. [ 1160.015518] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.015734] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.015807] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.016065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.016259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.029740] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 in Status: IN_PROGRESS for 2s [ 1160.174052] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.174238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.174276] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.174486] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.174575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.174674] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 is going to be updated. [ 1160.213878] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.214055] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.214119] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.214317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.214457] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.223602] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: IN_PROGRESS for 2s [ 1160.385667] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.385915] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.388594] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 704ea890-c37c-4b1e-a651-14860c7dba44 with status ACTIVE [ 1160.388594] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.388594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.388801] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.388874] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.388966] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.389167] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.389262] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.389317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.389476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.389663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.389844] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.389973] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.389973] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.390122] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.390198] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.390287] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 704ea890-c37c-4b1e-a651-14860c7dba44 is going to be updated. [ 1160.410464] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.410628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.410726] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.410934] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.411083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.411239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-704ea890-c37c-4b1e-a651-14860c7dba44" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.706329] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1160.706717] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 deletion is rescheduled due to dependency. [ 1160.706717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.706795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.706953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.707141] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.707253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.707318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.707472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.707551] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.707643] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.209830] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.712493] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.044065] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 in Status: SUCCESS [ 1162.044487] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.153808] env[69637]: INFO networking_nsxv3.common.synchronization [req-c798e589-2382-40af-863b-16ea114c3c4d req-348b9c29-9c3d-44a7-9b26-52872bf57cc0 tempest-ServerRescueNegativeTestJSON-1037752610 tempest-ServerRescueNegativeTestJSON-1037752610-project-member] Enqueued Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_members [ 1162.156515] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGHEST for action security_group_members [ 1162.156515] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.156515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.156515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.156515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.156515] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.156515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.156515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.156887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.156887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.156887] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.214639] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.214830] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.214830] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.215070] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.215161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.215328] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1162.231062] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: SUCCESS [ 1162.231254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.231417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.231622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.231861] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.231979] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.232059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.232222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.232396] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.232396] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.232503] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.243927] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.244081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.244187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.244381] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.244525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.253447] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1162.382622] env[69637]: INFO networking_nsxv3.common.synchronization [req-345b0e89-f77f-4d6c-9345-fa634121e9ad req-818cd36f-bf7e-43c8-b34a-79221bb46d8e tempest-ServersNegativeTestJSON-962136673 tempest-ServersNegativeTestJSON-962136673-project-member] Enqueued Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_members [ 1162.383181] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGHEST for action security_group_members [ 1162.383509] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.383604] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.383668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.384151] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.384151] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.384151] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.384374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.384374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.384465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.384512] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.658413] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.658599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.658684] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.658903] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.658996] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.659203] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.659300] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.659356] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.659502] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.659577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.659661] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 is going to be updated. [ 1162.700297] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.700467] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.700518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.700746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.700900] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.717136] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: IN_PROGRESS for 2s [ 1162.735195] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.735370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.735423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.735622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.735791] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.735895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.736348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.736348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.736348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.736496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.736919] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.736919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.736919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.736919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.737150] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.737231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.737278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.737405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.737495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.737614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.737684] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.887060] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.887271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.887383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.887589] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.887699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.887974] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.888142] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.888228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.888418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.888530] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.888659] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dab7827-c31f-472b-b986-30803c457337 is going to be updated. [ 1162.915451] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.915780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.915780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.915879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.916019] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.925508] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: IN_PROGRESS for 2s [ 1163.239490] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 938515a1-124c-4a31-9c35-b1d93a6612b5: rpc.has_security_group_logging(os_id): False [ 1163.272542] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.272657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.272750] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.273258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.273258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.273258] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.273489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.273489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.273568] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.273708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.273816] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.273920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.273969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.274115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.274189] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.274394] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.274464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.274527] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.274655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.274727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.274813] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 is going to be updated. [ 1163.368814] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.368966] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.369053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.369264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.369410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.385054] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: IN_PROGRESS for 2s [ 1164.056364] env[69637]: INFO networking_nsxv3.common.synchronization [req-c310fe1c-c776-4f00-8240-f46b7f886be5 req-8d5f2056-1b4f-45c8-84f6-e0a0093c0ed9 tempest-ServerActionsTestOtherA-1708466346 tempest-ServerActionsTestOtherA-1708466346-project-member] Enqueued Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_members [ 1164.056364] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGHEST for action security_group_members [ 1164.056364] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.056364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.056364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.056364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.056795] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.056795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.056795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.056795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.056795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.057134] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.119018] env[69637]: INFO networking_nsxv3.common.synchronization [req-c310fe1c-c776-4f00-8240-f46b7f886be5 req-8d5f2056-1b4f-45c8-84f6-e0a0093c0ed9 tempest-ServerActionsTestOtherA-1708466346 tempest-ServerActionsTestOtherA-1708466346-project-member] Enqueued Resource ID: d5aa788d-02ef-4dec-8c61-0a0011725217 with Priority: HIGHEST for action port [ 1164.119018] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5aa788d-02ef-4dec-8c61-0a0011725217 with Priority: HIGHEST for action port [ 1164.119018] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5aa788d-02ef-4dec-8c61-0a0011725217 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.119255] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5aa788d-02ef-4dec-8c61-0a0011725217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.119426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5aa788d-02ef-4dec-8c61-0a0011725217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.119701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5aa788d-02ef-4dec-8c61-0a0011725217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.120020] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5aa788d-02ef-4dec-8c61-0a0011725217',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.265210] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1164.265210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.265277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.265515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.265673] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.265781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.265841] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.265988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.266616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.266616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.266616] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.559600] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.559905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.560102] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.562116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.562116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.562303] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.562303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.562432] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.562520] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.562630] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.562723] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 is going to be updated. [ 1164.588582] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.588783] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.588852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.589137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.589252] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.598284] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 in Status: IN_PROGRESS for 2s [ 1164.622748] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5aa788d-02ef-4dec-8c61-0a0011725217 with status ACTIVE [ 1164.623082] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.623295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.623408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.623849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.623849] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.624103] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.624190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.624240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.624393] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.624478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.624705] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.624790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.624858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.624991] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.625094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.625211] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5aa788d-02ef-4dec-8c61-0a0011725217 is going to be updated. [ 1164.648234] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.648527] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.648527] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.648758] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.648974] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.649218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5aa788d-02ef-4dec-8c61-0a0011725217" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.732370] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 in Status: SUCCESS [ 1164.732617] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 deletion is rescheduled due to dependency. [ 1164.732739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.769502] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.770358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.770358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.770358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.770358] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.770358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.770358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.770358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.771456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.771456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.771456] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.771456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.771456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.771456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.771456] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.771456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.771456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.771456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.771456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.771456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.772821] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.821950] env[69637]: INFO networking_nsxv3.common.synchronization [req-4f375cb9-f67d-4ee4-a8cd-a065854ec9e8 req-919fd8e7-a1ab-41c5-99a4-475390570c2a tempest-ServersTestJSON-1659168521 tempest-ServersTestJSON-1659168521-project-member] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1164.823243] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1164.823563] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.823685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.823752] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.823949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.824108] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.824229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.824277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.824412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.824495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.824586] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.934552] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dab7827-c31f-472b-b986-30803c457337 in Status: SUCCESS [ 1164.934805] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dab7827-c31f-472b-b986-30803c457337 deletion is rescheduled due to dependency. [ 1164.934805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.273978] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7376d44-359d-46ab-85b9-78423d657c47: rpc.has_security_group_logging(os_id): False [ 1165.294676] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.294870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.294942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.295205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.295321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.295546] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.295655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.295895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.295895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.295989] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.296231] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.296331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.296426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.296575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.296668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.296906] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.296998] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.297068] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.297209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.297312] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.297402] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1165.327724] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.354230] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.354427] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.354479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.354683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.354826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.370993] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1165.409311] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: SUCCESS [ 1165.410129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.791296] env[69637]: INFO networking_nsxv3.common.synchronization [req-f268240f-ac29-4b71-a6dd-5c00fab06c4a req-c2c4c00f-83ec-4a7f-9646-2476e1a28e5d tempest-AttachVolumeTestJSON-2085947096 tempest-AttachVolumeTestJSON-2085947096-project-member] Enqueued Resource ID: cc38a146-8a93-4507-a45a-aaf042f5e30b with Priority: HIGHEST for action security_group_members [ 1165.791910] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc38a146-8a93-4507-a45a-aaf042f5e30b with Priority: HIGHEST for action security_group_members [ 1165.792235] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc38a146-8a93-4507-a45a-aaf042f5e30b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.793117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.793117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.793117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.793117] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.793117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.793117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.793473] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.793473] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.793473] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc38a146-8a93-4507-a45a-aaf042f5e30b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.829742] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.297063] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.297063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.297063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.297063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.328800] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.329182] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.329416] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.329538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.329765] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.329852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.329980] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc38a146-8a93-4507-a45a-aaf042f5e30b is going to be updated. [ 1166.331778] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.332023] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.332158] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.332417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.332512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.332634] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1166.364329] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.364469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.364555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.364743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.364888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.366637] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.366777] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.366838] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.366991] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.367147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.376986] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc38a146-8a93-4507-a45a-aaf042f5e30b in Status: IN_PROGRESS for 2s [ 1166.377690] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1166.606841] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 in Status: SUCCESS [ 1166.607014] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 deletion is rescheduled due to dependency. [ 1166.607134] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.384394] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1167.384978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.601031] env[69637]: INFO networking_nsxv3.common.synchronization [req-d5bb0e78-3df1-45ad-b9dd-888d8d82f8e4 req-8cdf51ea-7522-45ce-9ba9-e507de2e6cc1 tempest-ImagesOneServerNegativeTestJSON-1586387438 tempest-ImagesOneServerNegativeTestJSON-1586387438-project-member] Enqueued Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1167.601595] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGHEST for action security_group_members [ 1167.601902] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.605066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.605621] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.605621] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.605621] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.605784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.605784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.606070] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.606070] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.606070] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.113021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.113021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.113021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.113021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.113021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.113021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.113021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.113021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.113021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.113021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.113021] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 is going to be updated. [ 1168.153683] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.153861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.153916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.154136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.154274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.165846] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: IN_PROGRESS for 2s [ 1168.388804] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1168.389101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.389698] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc38a146-8a93-4507-a45a-aaf042f5e30b in Status: SUCCESS [ 1168.389849] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc38a146-8a93-4507-a45a-aaf042f5e30b deletion is rescheduled due to dependency. [ 1168.390207] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.172972] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: IN_PROGRESS for 4s [ 1172.109182] env[69637]: INFO networking_nsxv3.common.synchronization [None req-a5b4a847-227d-43e8-854d-b08c6921b8f3 None None] Enqueued Resource ID: af942d79-bd50-43a9-9153-40dd3260780d with Priority: HIGHEST for action port [ 1172.110057] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af942d79-bd50-43a9-9153-40dd3260780d with Priority: HIGHEST for action port [ 1172.110550] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-af942d79-bd50-43a9-9153-40dd3260780d taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.110777] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af942d79-bd50-43a9-9153-40dd3260780d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.110925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af942d79-bd50-43a9-9153-40dd3260780d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.111322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af942d79-bd50-43a9-9153-40dd3260780d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.111511] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af942d79-bd50-43a9-9153-40dd3260780d',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.185451] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 in Status: SUCCESS [ 1172.185700] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 deletion is rescheduled due to dependency. [ 1172.185853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.616670] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af942d79-bd50-43a9-9153-40dd3260780d [ 1172.616670] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.617209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.617209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.617572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.617699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.617849] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af942d79-bd50-43a9-9153-40dd3260780d already deleted. [ 1172.618244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af942d79-bd50-43a9-9153-40dd3260780d" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.808157] env[69637]: INFO networking_nsxv3.common.synchronization [None req-d28bee71-aa2f-45ef-9d4b-f1c099d9cf11 tempest-AttachVolumeShelveTestJSON-1899433646 tempest-AttachVolumeShelveTestJSON-1899433646-project-member] Enqueued Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_rules [ 1172.808719] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_rules [ 1172.809014] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43258334-5dc5-4214-9e8e-73f662ea7ef7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.810100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.810193] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.810479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.810570] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.912127] env[69637]: INFO networking_nsxv3.common.synchronization [None req-06a66eec-c8ae-4356-bd50-e74e5dbf54b5 tempest-AttachVolumeShelveTestJSON-1899433646 tempest-AttachVolumeShelveTestJSON-1899433646-project-member] Enqueued Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_rules [ 1172.912127] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_rules [ 1172.912127] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43258334-5dc5-4214-9e8e-73f662ea7ef7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.912127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.340860] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.341157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.341157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.341412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.341507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.341610] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 already deleted. [ 1173.341693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.341861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.342027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.345655] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.869624] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.869624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.869624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.869922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.870256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.870909] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 already deleted. [ 1173.870909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.296518] env[69637]: INFO networking_nsxv3.common.synchronization [None req-dcac5330-2422-4014-aa3a-8233099c9d96 tempest-AttachVolumeTestJSON-2085947096 tempest-AttachVolumeTestJSON-2085947096-project-member] Enqueued Resource ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 with Priority: HIGHEST for action security_group_rules [ 1174.297108] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 with Priority: HIGHEST for action security_group_rules [ 1174.297442] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10bfbfef-dd2c-4f67-b745-daf1a2635347 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.297540] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.303251] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.303251] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.303251] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10bfbfef-dd2c-4f67-b745-daf1a2635347',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.411605] env[69637]: INFO networking_nsxv3.common.synchronization [None req-f3afa2ed-c4d6-427a-a10a-2634c958e5fc tempest-AttachVolumeTestJSON-2085947096 tempest-AttachVolumeTestJSON-2085947096-project-member] Enqueued Resource ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 with Priority: HIGHEST for action security_group_rules [ 1174.412249] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 with Priority: HIGHEST for action security_group_rules [ 1174.412900] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10bfbfef-dd2c-4f67-b745-daf1a2635347 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.413015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.591610] env[69637]: INFO networking_nsxv3.common.synchronization [None req-dd40374a-583c-4400-b4c5-7b8d7b775ca6 None None] Enqueued Resource ID: 0a8246da-d749-4c61-af52-4ba95e9176f1 with Priority: HIGHEST for action port [ 1174.591610] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8246da-d749-4c61-af52-4ba95e9176f1 with Priority: HIGHEST for action port [ 1174.592096] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a8246da-d749-4c61-af52-4ba95e9176f1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.592096] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a8246da-d749-4c61-af52-4ba95e9176f1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.592096] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a8246da-d749-4c61-af52-4ba95e9176f1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.592381] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a8246da-d749-4c61-af52-4ba95e9176f1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.592463] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a8246da-d749-4c61-af52-4ba95e9176f1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.730137] env[69637]: INFO networking_nsxv3.common.synchronization [req-c5d1273a-56b2-4c05-9a8c-876df7e03c8d req-10940fd3-0aca-436f-89df-83d7995129d0 tempest-ServersTestJSON-1659168521 tempest-ServersTestJSON-1659168521-project-member] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1174.730603] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGHEST for action security_group_members [ 1174.730913] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.731057] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.731140] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.731349] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.731507] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.731603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.731691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.732911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.732911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.732911] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.824501] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.824693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.824736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.824936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.825049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.825150] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 already deleted. [ 1174.825233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.825381] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.825537] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.825620] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10bfbfef-dd2c-4f67-b745-daf1a2635347',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.095414] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a8246da-d749-4c61-af52-4ba95e9176f1 [ 1175.095684] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.095866] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.095976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.096247] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.096379] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.096494] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a8246da-d749-4c61-af52-4ba95e9176f1 already deleted. [ 1175.096604] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a8246da-d749-4c61-af52-4ba95e9176f1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.234572] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.234697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.234764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.235013] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.235152] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.235389] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.235493] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.235555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.235717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.235797] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.235888] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be updated. [ 1175.261232] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.261390] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.261474] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.261686] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.261832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.270290] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: IN_PROGRESS for 2s [ 1175.344757] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.344757] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.344757] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.345036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.345036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.345097] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 already deleted. [ 1175.345145] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.280102] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 in Status: SUCCESS [ 1177.280376] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 deletion is rescheduled due to dependency. [ 1177.280413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.415906] env[69637]: INFO networking_nsxv3.common.synchronization [req-098e32d8-f16b-4674-a112-afbae80b32e5 req-2946bc0f-2b28-41ca-8579-b8d4e3ce1979 tempest-AttachVolumeShelveTestJSON-1899433646 tempest-AttachVolumeShelveTestJSON-1899433646-project-member] Enqueued Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_members [ 1179.416264] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_members [ 1179.416569] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-43258334-5dc5-4214-9e8e-73f662ea7ef7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.416689] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.416755] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.416991] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.417154] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.417252] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.417313] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.417459] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.417541] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.417860] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.728115] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.728115] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.728295] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.728912] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.729008] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.729234] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.729392] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.729691] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.729924] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.730176] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.730293] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.730407] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.730518] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.730632] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.730742] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.730883] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.751164] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.751316] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1179.751452] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.751618] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.751885] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-2363d49f-aa87-4174-857b-388a4221f960 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.752059] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.752199] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.752480] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.752622] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2363d49f-aa87-4174-857b-388a4221f960',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.920519] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.920674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.920747] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.920982] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.921088] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.921290] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.921411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.921452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.921593] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.921667] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.921748] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 already deleted. [ 1179.921824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.255081] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.255081] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.255081] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.255341] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.255497] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.255652] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 2363d49f-aa87-4174-857b-388a4221f960 not found, creating... [ 1180.255912] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.256147] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.256214] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.256431] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.256570] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.256853] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.257053] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.257184] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.257396] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.257535] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.257677] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 2363d49f-aa87-4174-857b-388a4221f960 is going to be created. [ 1180.276742] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.276944] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.277085] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.277344] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.277573] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.277843] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.952409] env[69637]: INFO networking_nsxv3.common.synchronization [req-098e32d8-f16b-4674-a112-afbae80b32e5 req-391b61ff-0c1b-4c84-b4e8-df92b8edc6a6 service nova] Enqueued Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_rules [ 1180.952648] env[69637]: INFO networking_nsxv3.common.synchronization [req-098e32d8-f16b-4674-a112-afbae80b32e5 req-391b61ff-0c1b-4c84-b4e8-df92b8edc6a6 service nova] Enqueued Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_members [ 1180.952759] env[69637]: INFO networking_nsxv3.common.synchronization [req-098e32d8-f16b-4674-a112-afbae80b32e5 req-391b61ff-0c1b-4c84-b4e8-df92b8edc6a6 service nova] Enqueued Resource ID: 2363d49f-aa87-4174-857b-388a4221f960 with Priority: HIGHEST for action port [ 1180.953238] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_rules [ 1180.953376] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_members [ 1180.953469] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2363d49f-aa87-4174-857b-388a4221f960 with Priority: HIGHEST for action port [ 1180.953732] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43258334-5dc5-4214-9e8e-73f662ea7ef7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.953854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.953923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.954190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.954274] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.956124] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-43258334-5dc5-4214-9e8e-73f662ea7ef7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.956239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.956269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.956443] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.956590] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.956688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.956753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.956892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.956976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.957462] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.958188] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-2363d49f-aa87-4174-857b-388a4221f960 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.958293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.958361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.958511] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.958585] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2363d49f-aa87-4174-857b-388a4221f960',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.456451] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-43258334-5dc5-4214-9e8e-73f662ea7ef7 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.456622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.461134] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2363d49f-aa87-4174-857b-388a4221f960 with status ACTIVE [ 1181.461380] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.461487] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.461548] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.461768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.461863] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.462087] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.462192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.462232] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.462373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.462448] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.462632] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.462724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.462779] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.462920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.462990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.463083] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2363d49f-aa87-4174-857b-388a4221f960 is going to be updated. [ 1181.464249] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.484723] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.484723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.484723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.484919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.485017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.485188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.967258] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.470885] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.471089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.471172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.471373] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.471464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.471565] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 is going to be created. [ 1182.495369] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.495608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.495725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.496064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.496322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.505943] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 in Status: UNINITIALIZED for 2s [ 1183.408522] env[69637]: INFO networking_nsxv3.common.synchronization [req-41adba00-53db-48b6-b135-94e2d0546d3d req-0670a5d9-8be9-493b-8a56-4d326a364330 tempest-AttachVolumeTestJSON-2085947096 tempest-AttachVolumeTestJSON-2085947096-project-member] Enqueued Resource ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 with Priority: HIGHEST for action security_group_members [ 1183.409424] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 with Priority: HIGHEST for action security_group_members [ 1183.409886] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-10bfbfef-dd2c-4f67-b745-daf1a2635347 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.412101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.412101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.412101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.412101] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.412101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.412101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.412101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.412101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.412101] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10bfbfef-dd2c-4f67-b745-daf1a2635347',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.915608] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.915817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.915915] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.916218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.916394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.916588] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.916726] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.916812] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.917033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.917126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.917238] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 already deleted. [ 1183.917341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.949849] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-193 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.950062] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-193" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.950202] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-193" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.950459] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-193" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.950719] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.951054] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.951182] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.952062] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.952062] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.952062] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1183.952062] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1183.952062] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1183.952377] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1183.952377] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1183.952377] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1183.952468] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1183.970025] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1183.970310] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1183.970457] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1183.970635] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-193" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.971077] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-effaf8b8-1c2a-48a9-b615-539deffb5407 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.971203] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-effaf8b8-1c2a-48a9-b615-539deffb5407" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.971330] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-effaf8b8-1c2a-48a9-b615-539deffb5407" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.971651] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-effaf8b8-1c2a-48a9-b615-539deffb5407" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.971791] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('effaf8b8-1c2a-48a9-b615-539deffb5407',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.013187] env[69637]: INFO networking_nsxv3.common.synchronization [req-94b4f8e7-f8fc-42eb-bc42-8d0474c47f0d req-496babcd-bf49-45c2-ab63-eede9cd11553 tempest-DeleteServersTestJSON-1864882804 tempest-DeleteServersTestJSON-1864882804-project-member] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1184.013954] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1184.014062] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.014130] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.014196] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.014396] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.014545] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.015013] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.015102] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.015271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.015360] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.015455] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.474203] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.474475] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.474564] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.474840] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.475015] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.475161] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port effaf8b8-1c2a-48a9-b615-539deffb5407 not found, creating... [ 1184.475419] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.475579] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.475700] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.475954] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.476068] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.476358] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.476517] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.476638] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.476846] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.476987] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.477141] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: effaf8b8-1c2a-48a9-b615-539deffb5407 is going to be created. [ 1184.495870] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.496124] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.496258] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.496527] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.496764] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.496996] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-effaf8b8-1c2a-48a9-b615-539deffb5407" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.515857] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 in Status: SUCCESS [ 1184.515857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.515857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.517796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.517796] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.517796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.517796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.517796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.518061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.518061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.518061] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.519012] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.519123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.519196] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.519357] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.519438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.519613] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.519707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.519769] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.519952] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.520030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.520093] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1184.560251] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.560454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.560454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.560723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.560852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.574462] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1185.022239] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.189930] env[69637]: INFO networking_nsxv3.common.synchronization [req-41adba00-53db-48b6-b135-94e2d0546d3d req-6314d9fa-c376-402d-8c7c-8d8c9ddb80a8 service nova] Enqueued Resource ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 with Priority: HIGHEST for action security_group_rules [ 1185.190146] env[69637]: INFO networking_nsxv3.common.synchronization [req-41adba00-53db-48b6-b135-94e2d0546d3d req-6314d9fa-c376-402d-8c7c-8d8c9ddb80a8 service nova] Enqueued Resource ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 with Priority: HIGHEST for action security_group_members [ 1185.190268] env[69637]: INFO networking_nsxv3.common.synchronization [req-41adba00-53db-48b6-b135-94e2d0546d3d req-6314d9fa-c376-402d-8c7c-8d8c9ddb80a8 service nova] Enqueued Resource ID: effaf8b8-1c2a-48a9-b615-539deffb5407 with Priority: HIGHEST for action port [ 1185.190509] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 with Priority: HIGHEST for action security_group_rules [ 1185.190675] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 with Priority: HIGHEST for action security_group_members [ 1185.190724] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: effaf8b8-1c2a-48a9-b615-539deffb5407 with Priority: HIGHEST for action port [ 1185.192039] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10bfbfef-dd2c-4f67-b745-daf1a2635347 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.192039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.192039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.192039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.192039] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10bfbfef-dd2c-4f67-b745-daf1a2635347',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.192561] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-10bfbfef-dd2c-4f67-b745-daf1a2635347 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.192674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.192740] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.194236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.194236] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.194236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.194236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.194236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.194236] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.194236] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10bfbfef-dd2c-4f67-b745-daf1a2635347',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.194812] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-effaf8b8-1c2a-48a9-b615-539deffb5407 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.194812] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-effaf8b8-1c2a-48a9-b615-539deffb5407" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.194812] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-effaf8b8-1c2a-48a9-b615-539deffb5407" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.194812] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-effaf8b8-1c2a-48a9-b615-539deffb5407" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.194812] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('effaf8b8-1c2a-48a9-b615-539deffb5407',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.524389] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43258334-5dc5-4214-9e8e-73f662ea7ef7: rpc.has_security_group_logging(os_id): False [ 1185.543201] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.543369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.543442] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.543666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.543757] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.544039] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.544151] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.544217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.544394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.544444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.544532] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 is going to be created. [ 1185.602722] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.602898] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.602947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.603164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.603350] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.614145] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 in Status: IN_PROGRESS for 2s [ 1185.696873] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10bfbfef-dd2c-4f67-b745-daf1a2635347',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.697744] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-10bfbfef-dd2c-4f67-b745-daf1a2635347 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.697861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.697997] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port effaf8b8-1c2a-48a9-b615-539deffb5407 with status ACTIVE [ 1185.698170] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.698277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.699027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.699027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.699027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.699027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.699027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.699027] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.699369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.699369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.699369] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.699516] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.699516] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.700786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.700786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.700786] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: effaf8b8-1c2a-48a9-b615-539deffb5407 is going to be updated. [ 1185.736483] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.737336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.737336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.737336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.737336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.737336] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-effaf8b8-1c2a-48a9-b615-539deffb5407" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.202128] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10bfbfef-dd2c-4f67-b745-daf1a2635347',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.584352] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1186.584610] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 deletion is rescheduled due to dependency. [ 1186.584647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.704946] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.704946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.704946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.705218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.705218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.705218] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 is going to be created. [ 1186.727105] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.727105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.727105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.727251] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.728181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.736687] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 in Status: UNINITIALIZED for 2s [ 1187.625469] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 in Status: SUCCESS [ 1187.625811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.744904] env[69637]: INFO networking_nsxv3.common.synchronization [req-503c8188-1c52-479d-90b2-1fd062039c97 req-f92fa4be-21f6-431f-808b-b4ff9db618e1 tempest-ServerActionsTestOtherA-1708466346 tempest-ServerActionsTestOtherA-1708466346-project-member] Enqueued Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_members [ 1188.745402] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_members [ 1188.746367] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 in Status: SUCCESS [ 1188.746569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.748222] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-69c7681d-644f-47c6-8228-9fc17f49b5a3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.748222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.748222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.748222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.748222] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.748222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.748222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.748222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.748222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.748222] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.748725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.749218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.749218] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.749218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.749381] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.749415] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.749466] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.749544] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.749624] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10bfbfef-dd2c-4f67-b745-daf1a2635347',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.211217] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-310 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.211489] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.211573] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.211848] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.212190] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.212610] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.212610] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.212715] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.212853] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.213083] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.213200] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1189.213309] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1189.213420] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1189.213529] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.213640] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1189.213791] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1189.231695] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1189.231873] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1189.232039] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1189.232222] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-310" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.232533] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-944b64b5-6843-4c0a-a6f0-b1984ada62ab taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.232710] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-944b64b5-6843-4c0a-a6f0-b1984ada62ab" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.232835] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-944b64b5-6843-4c0a-a6f0-b1984ada62ab" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.233185] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-944b64b5-6843-4c0a-a6f0-b1984ada62ab" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.233326] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('944b64b5-6843-4c0a-a6f0-b1984ada62ab',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.251684] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.252437] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10bfbfef-dd2c-4f67-b745-daf1a2635347',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.735981] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.736284] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.736422] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.736729] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.736901] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.737124] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 944b64b5-6843-4c0a-a6f0-b1984ada62ab not found, creating... [ 1189.737448] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.737643] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.737788] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.738121] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.738363] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.738668] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.738990] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.738990] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.739305] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.739484] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.739653] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 944b64b5-6843-4c0a-a6f0-b1984ada62ab is going to be created. [ 1189.753728] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.757809] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10bfbfef-dd2c-4f67-b745-daf1a2635347: rpc.has_security_group_logging(os_id): False [ 1189.757809] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.758146] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.758265] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.758494] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.758902] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.759154] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-944b64b5-6843-4c0a-a6f0-b1984ada62ab" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.771250] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.771400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.771461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.771655] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.771743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.772241] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.772378] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.772448] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.772611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.772691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.772779] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 is going to be created. [ 1189.925106] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.925305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.925360] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.925533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.925713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.944117] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 in Status: IN_PROGRESS for 2s [ 1190.256699] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.256699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.256699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.256965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.256965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.257138] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 is going to be updated. [ 1190.285233] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.285233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.285233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.285233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.285233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.293942] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 in Status: IN_PROGRESS for 2s [ 1190.461815] env[69637]: INFO networking_nsxv3.common.synchronization [req-503c8188-1c52-479d-90b2-1fd062039c97 req-9688f1ed-42f8-4de7-8bbb-260211a524c8 service nova] Enqueued Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_rules [ 1190.462040] env[69637]: INFO networking_nsxv3.common.synchronization [req-503c8188-1c52-479d-90b2-1fd062039c97 req-9688f1ed-42f8-4de7-8bbb-260211a524c8 service nova] Enqueued Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_members [ 1190.462200] env[69637]: INFO networking_nsxv3.common.synchronization [req-503c8188-1c52-479d-90b2-1fd062039c97 req-9688f1ed-42f8-4de7-8bbb-260211a524c8 service nova] Enqueued Resource ID: 944b64b5-6843-4c0a-a6f0-b1984ada62ab with Priority: HIGHEST for action port [ 1190.462907] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_rules [ 1190.463103] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_members [ 1190.463274] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 944b64b5-6843-4c0a-a6f0-b1984ada62ab with Priority: HIGHEST for action port [ 1190.463460] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69c7681d-644f-47c6-8228-9fc17f49b5a3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.463579] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.463643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.463881] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.463964] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.466707] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-69c7681d-644f-47c6-8228-9fc17f49b5a3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.466707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.466707] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-944b64b5-6843-4c0a-a6f0-b1984ada62ab taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.466707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-944b64b5-6843-4c0a-a6f0-b1984ada62ab" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.466707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-944b64b5-6843-4c0a-a6f0-b1984ada62ab" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.466707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-944b64b5-6843-4c0a-a6f0-b1984ada62ab" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.466707] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('944b64b5-6843-4c0a-a6f0-b1984ada62ab',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.967244] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-69c7681d-644f-47c6-8228-9fc17f49b5a3 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.967629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.970874] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 944b64b5-6843-4c0a-a6f0-b1984ada62ab with status ACTIVE [ 1190.971071] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.971210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.971280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.971521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.971648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.971793] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.971912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.971948] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.972137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.972214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.972398] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.972550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.972610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.972752] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.972833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.972899] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 944b64b5-6843-4c0a-a6f0-b1984ada62ab is going to be updated. [ 1190.996830] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.996973] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.997030] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.997240] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.998070] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.998070] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-944b64b5-6843-4c0a-a6f0-b1984ada62ab" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.955986] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 in Status: SUCCESS [ 1191.956276] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.302880] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 in Status: SUCCESS [ 1192.303239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.303386] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.303640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.303851] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.303993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.304080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.304275] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.304398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.304515] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.807498] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.310475] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.813066] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.813241] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.813356] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.813591] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.813688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.813806] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 is going to be updated. [ 1193.842619] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.842832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.842997] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.843279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.843498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.854425] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 in Status: IN_PROGRESS for 2s [ 1195.081905] env[69637]: INFO networking_nsxv3.common.synchronization [req-0dc5189c-e4ee-4341-be70-d61121c9cf3a req-5098b440-e24b-43a9-a988-6baa0d546bc2 tempest-ServerActionsTestOtherB-2018875684 tempest-ServerActionsTestOtherB-2018875684-project-member] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1195.082204] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1195.082610] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.082789] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.082837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.083460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.083460] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.083460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.083460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.083816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.083816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.083816] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.586504] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.586691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.586754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.587063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.587154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.587346] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.587455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.587507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.587659] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.587725] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.587965] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 is going to be updated. [ 1195.613155] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.613328] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.613384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.613654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.613749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.622602] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: IN_PROGRESS for 2s [ 1195.863062] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 in Status: SUCCESS [ 1195.863303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.863475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.863723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.863935] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.864099] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.864199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.864399] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.864494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.864607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.864712] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.358343] env[69637]: INFO networking_nsxv3.common.synchronization [req-4911f9aa-0e30-441a-b8d9-16ad7cafdfcd req-daddba71-1cdc-4c0b-b455-d3c33a2d1271 tempest-DeleteServersTestJSON-1864882804 tempest-DeleteServersTestJSON-1864882804-project-member] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1196.358626] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1196.358667] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.359338] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.359338] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.359338] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.359338] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.359338] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.359662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.359662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.359662] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.359926] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.367094] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.633229] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.633229] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.633229] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.633229] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.633459] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.633634] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.633750] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.633974] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.634220] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.634340] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1196.634455] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1196.634566] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1196.634679] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1196.634790] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1196.634905] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1196.635047] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1196.652458] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1196.652629] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1196.652775] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1196.652990] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.653321] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-30f05a97-f0d4-486b-a2ea-df3c351ad275 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.653549] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-30f05a97-f0d4-486b-a2ea-df3c351ad275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.653624] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-30f05a97-f0d4-486b-a2ea-df3c351ad275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.653946] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-30f05a97-f0d4-486b-a2ea-df3c351ad275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.654158] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30f05a97-f0d4-486b-a2ea-df3c351ad275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.861667] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.861925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.861925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.862126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.862293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.862442] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.862539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.862604] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.862758] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.862835] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.862922] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1196.868554] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69c7681d-644f-47c6-8228-9fc17f49b5a3: rpc.has_security_group_logging(os_id): False [ 1196.889250] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.889456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.889569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.889938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.899593] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.901820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.901820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.901820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.901820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.914184] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1196.919957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.920302] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.920417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.920488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.920706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.920806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.920940] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 is going to be updated. [ 1197.010033] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.010033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.010254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.010399] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.010728] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.026021] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 in Status: IN_PROGRESS for 2s [ 1197.156795] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.156974] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.157118] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.157448] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.157605] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.157764] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 30f05a97-f0d4-486b-a2ea-df3c351ad275 not found, creating... [ 1197.158105] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.158270] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.158390] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.158611] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.158752] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.159043] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.159212] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.159321] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.159532] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.159670] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.159856] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 30f05a97-f0d4-486b-a2ea-df3c351ad275 is going to be created. [ 1197.184568] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.184766] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.184891] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.185226] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.185414] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.185631] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-30f05a97-f0d4-486b-a2ea-df3c351ad275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.634281] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: SUCCESS [ 1197.634281] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 deletion is rescheduled due to dependency. [ 1197.634281] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.861839] env[69637]: INFO networking_nsxv3.common.synchronization [req-4911f9aa-0e30-441a-b8d9-16ad7cafdfcd req-845c1924-27e1-4299-8f29-73315b7c49f7 service nova] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_rules [ 1197.862070] env[69637]: INFO networking_nsxv3.common.synchronization [req-4911f9aa-0e30-441a-b8d9-16ad7cafdfcd req-845c1924-27e1-4299-8f29-73315b7c49f7 service nova] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1197.862220] env[69637]: INFO networking_nsxv3.common.synchronization [req-4911f9aa-0e30-441a-b8d9-16ad7cafdfcd req-845c1924-27e1-4299-8f29-73315b7c49f7 service nova] Enqueued Resource ID: 30f05a97-f0d4-486b-a2ea-df3c351ad275 with Priority: HIGHEST for action port [ 1197.862449] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_rules [ 1197.862576] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1197.862673] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f05a97-f0d4-486b-a2ea-df3c351ad275 with Priority: HIGHEST for action port [ 1197.863320] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.863450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.863513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.863719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.863800] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.868052] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.868189] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.868402] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-30f05a97-f0d4-486b-a2ea-df3c351ad275 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.868505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30f05a97-f0d4-486b-a2ea-df3c351ad275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.868572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30f05a97-f0d4-486b-a2ea-df3c351ad275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.868742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30f05a97-f0d4-486b-a2ea-df3c351ad275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.868817] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30f05a97-f0d4-486b-a2ea-df3c351ad275',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.370807] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.371012] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.372436] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30f05a97-f0d4-486b-a2ea-df3c351ad275 with status ACTIVE [ 1198.372629] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.372749] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.372818] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.373053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.373146] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.373325] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.373424] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.373487] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.373639] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.373718] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.373900] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.373993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.374068] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.374208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.374282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.374366] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30f05a97-f0d4-486b-a2ea-df3c351ad275 is going to be updated. [ 1198.403249] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.403428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.403489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.403668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.403809] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.403972] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30f05a97-f0d4-486b-a2ea-df3c351ad275" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.925518] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1198.925518] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 deletion is rescheduled due to dependency. [ 1198.925518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.925518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.925518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.925518] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.925518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.925518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.925518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.925518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.925518] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.037174] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 in Status: SUCCESS [ 1199.037412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.429060] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.931031] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.433890] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.434024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.434024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.434299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.434423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.434555] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1200.460432] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.460606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.460697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.460930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.461550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.468956] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1202.479619] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1202.480068] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.480068] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.480298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.480484] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.480601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.480660] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.480840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.480941] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.481046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.481148] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.863660] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1202.863660] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1202.983766] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.983766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.983766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.983996] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.984077] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.984199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.984264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.984420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.984506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.984594] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.984738] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.984844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.984887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.985032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.985169] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.985258] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.985319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.985454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.985528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.985607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.985695] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.487461] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7376d44-359d-46ab-85b9-78423d657c47: rpc.has_security_group_logging(os_id): False [ 1203.505141] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.505141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.505459] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.505459] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.505584] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.505705] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.505795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.505852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.505999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.506100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.506293] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.506409] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.506465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.506562] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.506627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.506818] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.506904] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.506959] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.507121] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.507192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.507258] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1203.562444] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.562676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.562676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.562956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.563239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.575516] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1205.590483] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1205.590809] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.634662] env[69637]: INFO networking_nsxv3.common.synchronization [req-d2dc52bc-c7fb-43aa-9b53-7042e87d9d26 req-29537e61-deaa-49bd-b60c-575d95f3de7f tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 with Priority: HIGHEST for action security_group_members [ 1206.635625] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 with Priority: HIGHEST for action security_group_members [ 1206.636087] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.636263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.636263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.636543] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.637167] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.637167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.637167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.637334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.637401] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.637759] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.879452] env[69637]: INFO networking_nsxv3.common.synchronization [req-b00108e3-02bb-42aa-8645-fd9d1356d279 req-4b91ffcd-3ef2-47a1-89b6-26e41c15401e tempest-ServerActionsTestOtherB-2018875684 tempest-ServerActionsTestOtherB-2018875684-project-member] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1206.879452] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1206.879452] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.879452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.879452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.879452] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.879452] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.879766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.879766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.879766] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.879879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.880495] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.141353] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.141353] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.141353] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.141577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.141672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.141846] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.141935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.141987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.142159] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.142243] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.142330] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 is going to be updated. [ 1207.170856] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.171052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.171122] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.171275] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.171409] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.179056] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 in Status: IN_PROGRESS for 2s [ 1207.186527] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-680 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.186738] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.186874] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.187166] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.187448] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.187624] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.187749] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.187985] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.188151] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.188449] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.188569] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1207.188693] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1207.188800] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1207.188917] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.189037] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1207.189173] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1207.205985] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1207.206165] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1207.206373] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1207.206465] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.206746] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-aba5763d-f8f7-4329-a0a3-6db72185549a taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.206913] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-aba5763d-f8f7-4329-a0a3-6db72185549a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.207053] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-aba5763d-f8f7-4329-a0a3-6db72185549a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.207351] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-aba5763d-f8f7-4329-a0a3-6db72185549a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.207494] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aba5763d-f8f7-4329-a0a3-6db72185549a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.382689] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.382823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.382875] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.383114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.383212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.383412] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.383704] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.383704] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.383704] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.383890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.383890] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 is going to be updated. [ 1207.424142] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.424342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.424430] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.424666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.424813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.434039] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: IN_PROGRESS for 2s [ 1207.710672] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.711128] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.711260] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.711704] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.711813] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.711985] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port aba5763d-f8f7-4329-a0a3-6db72185549a not found, creating... [ 1207.712353] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.712577] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.712703] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.712952] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.713134] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.713515] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.713699] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.713843] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.714117] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.714300] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.714472] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: aba5763d-f8f7-4329-a0a3-6db72185549a is going to be created. [ 1207.733143] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.733353] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.733467] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.733725] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.733996] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.734240] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-aba5763d-f8f7-4329-a0a3-6db72185549a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.414236] env[69637]: INFO networking_nsxv3.common.synchronization [req-b00108e3-02bb-42aa-8645-fd9d1356d279 req-a88c52ba-d74d-4afb-a24b-0fcd0ec702b1 service nova] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_rules [ 1208.414236] env[69637]: INFO networking_nsxv3.common.synchronization [req-b00108e3-02bb-42aa-8645-fd9d1356d279 req-a88c52ba-d74d-4afb-a24b-0fcd0ec702b1 service nova] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1208.414236] env[69637]: INFO networking_nsxv3.common.synchronization [req-b00108e3-02bb-42aa-8645-fd9d1356d279 req-a88c52ba-d74d-4afb-a24b-0fcd0ec702b1 service nova] Enqueued Resource ID: aba5763d-f8f7-4329-a0a3-6db72185549a with Priority: HIGHEST for action port [ 1208.414236] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_rules [ 1208.414236] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1208.414236] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba5763d-f8f7-4329-a0a3-6db72185549a with Priority: HIGHEST for action port [ 1208.414658] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.414994] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.415203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.415681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.415893] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.417253] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.419910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.419910] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-aba5763d-f8f7-4329-a0a3-6db72185549a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.419910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aba5763d-f8f7-4329-a0a3-6db72185549a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.419910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aba5763d-f8f7-4329-a0a3-6db72185549a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.419910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aba5763d-f8f7-4329-a0a3-6db72185549a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.419910] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aba5763d-f8f7-4329-a0a3-6db72185549a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.920128] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.920447] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.920447] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aba5763d-f8f7-4329-a0a3-6db72185549a with status ACTIVE [ 1208.921485] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.921485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.921485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.921485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.921485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.921485] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.921485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.921485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.921946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.921946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.921946] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.923123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.923346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.923554] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.923642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.923735] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aba5763d-f8f7-4329-a0a3-6db72185549a is going to be updated. [ 1208.945615] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.945797] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.945901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.946383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.946546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.946746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aba5763d-f8f7-4329-a0a3-6db72185549a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.187877] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 in Status: SUCCESS [ 1209.188094] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2 deletion is rescheduled due to dependency. [ 1209.188181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.443097] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: SUCCESS [ 1209.443333] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 deletion is rescheduled due to dependency. [ 1209.443473] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.443670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.443936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.444166] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.444297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.444394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.444572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.444681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.444780] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.947378] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.449959] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.952275] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.952607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.952607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.952826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.952945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.953089] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 is going to be updated. [ 1210.978868] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.979018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.979094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.979343] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.979497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.987724] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: IN_PROGRESS for 2s [ 1211.184519] env[69637]: INFO networking_nsxv3.common.synchronization [None req-afe6d45b-a68a-4703-a222-013e64778330 tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: 40652021-5874-414e-9ac7-ab3119a69b5b with Priority: HIGHEST for action security_group_rules [ 1211.185115] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40652021-5874-414e-9ac7-ab3119a69b5b with Priority: HIGHEST for action security_group_rules [ 1211.185486] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40652021-5874-414e-9ac7-ab3119a69b5b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.185645] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.185720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.185976] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.186076] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40652021-5874-414e-9ac7-ab3119a69b5b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.271612] env[69637]: INFO networking_nsxv3.common.synchronization [None req-06d57418-53d2-43c3-8dba-fc89e10feef5 tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: 40652021-5874-414e-9ac7-ab3119a69b5b with Priority: HIGHEST for action security_group_rules [ 1211.272230] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40652021-5874-414e-9ac7-ab3119a69b5b with Priority: HIGHEST for action security_group_rules [ 1211.272559] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40652021-5874-414e-9ac7-ab3119a69b5b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.272775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.704576] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.704727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.705131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.705131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.705131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.705247] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40652021-5874-414e-9ac7-ab3119a69b5b already deleted. [ 1211.705279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.705421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.705574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.705653] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40652021-5874-414e-9ac7-ab3119a69b5b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.225445] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.225840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.225840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.225921] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.226046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.226088] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40652021-5874-414e-9ac7-ab3119a69b5b already deleted. [ 1212.226176] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.996674] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: SUCCESS [ 1212.996872] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.997034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.997251] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.997936] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.997936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.997936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.997936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.997936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.997936] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.998470] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.500066] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.002677] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abc9ca0b-4c93-42fd-9003-750112e8dab1: rpc.has_security_group_logging(os_id): False [ 1214.020983] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.021470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.021470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.021545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.021669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.021905] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.022029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.022099] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.022253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.022332] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.022421] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 is going to be updated. [ 1214.075465] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.075643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.075682] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.076657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.076657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.088228] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: IN_PROGRESS for 2s [ 1216.105575] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: SUCCESS [ 1216.105923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.274011] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1216.274011] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1216.740410] env[69637]: INFO networking_nsxv3.common.synchronization [req-9928da73-2008-4aaf-adb4-3e0ab5d41d48 req-e9a61abe-dc1d-4968-8daa-c9e50cdecff2 tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: 40652021-5874-414e-9ac7-ab3119a69b5b with Priority: HIGHEST for action security_group_members [ 1216.740577] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40652021-5874-414e-9ac7-ab3119a69b5b with Priority: HIGHEST for action security_group_members [ 1216.740884] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-40652021-5874-414e-9ac7-ab3119a69b5b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.741085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.741163] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.741423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.741579] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.741688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.741739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.741882] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.741965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.742080] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40652021-5874-414e-9ac7-ab3119a69b5b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.043630] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-19 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.044147] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.044147] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.044259] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.044466] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.044628] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.044752] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.044975] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.045142] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.045356] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1217.045562] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1217.045617] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1217.045690] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1217.045802] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1217.045914] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1217.046062] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1217.064013] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1217.064257] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1217.064407] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1217.064589] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-19" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.065208] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-ee88b1ac-7274-488f-811f-76264a05e9f0 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.065208] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-ee88b1ac-7274-488f-811f-76264a05e9f0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.065377] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-ee88b1ac-7274-488f-811f-76264a05e9f0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.065670] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-ee88b1ac-7274-488f-811f-76264a05e9f0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.066466] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee88b1ac-7274-488f-811f-76264a05e9f0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.244906] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.245412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.245412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.245412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.245546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.245729] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.245909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.245909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.246121] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.246121] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.246121] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40652021-5874-414e-9ac7-ab3119a69b5b already deleted. [ 1217.246269] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.568866] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.569084] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.569214] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.569496] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.569701] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.569904] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port ee88b1ac-7274-488f-811f-76264a05e9f0 not found, creating... [ 1217.570312] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.570493] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.570617] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.570867] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.571044] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.571393] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.571561] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.571733] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.571927] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.572164] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.572324] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: ee88b1ac-7274-488f-811f-76264a05e9f0 is going to be created. [ 1217.590930] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.591177] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.591288] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.591540] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.591786] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.592173] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-ee88b1ac-7274-488f-811f-76264a05e9f0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.269436] env[69637]: INFO networking_nsxv3.common.synchronization [req-9928da73-2008-4aaf-adb4-3e0ab5d41d48 req-65ff6549-94bb-4fd0-855b-22c71c06721c service nova] Enqueued Resource ID: 40652021-5874-414e-9ac7-ab3119a69b5b with Priority: HIGHEST for action security_group_rules [ 1218.269698] env[69637]: INFO networking_nsxv3.common.synchronization [req-9928da73-2008-4aaf-adb4-3e0ab5d41d48 req-65ff6549-94bb-4fd0-855b-22c71c06721c service nova] Enqueued Resource ID: 40652021-5874-414e-9ac7-ab3119a69b5b with Priority: HIGHEST for action security_group_members [ 1218.269748] env[69637]: INFO networking_nsxv3.common.synchronization [req-9928da73-2008-4aaf-adb4-3e0ab5d41d48 req-65ff6549-94bb-4fd0-855b-22c71c06721c service nova] Enqueued Resource ID: ee88b1ac-7274-488f-811f-76264a05e9f0 with Priority: HIGHEST for action port [ 1218.270036] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40652021-5874-414e-9ac7-ab3119a69b5b with Priority: HIGHEST for action security_group_rules [ 1218.270166] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40652021-5874-414e-9ac7-ab3119a69b5b with Priority: HIGHEST for action security_group_members [ 1218.270270] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee88b1ac-7274-488f-811f-76264a05e9f0 with Priority: HIGHEST for action port [ 1218.270816] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40652021-5874-414e-9ac7-ab3119a69b5b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.270947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.274839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.274839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.274839] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40652021-5874-414e-9ac7-ab3119a69b5b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.274839] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-40652021-5874-414e-9ac7-ab3119a69b5b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.274839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.274839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.274839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.274839] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.274839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.274839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.275476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.275476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.275476] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40652021-5874-414e-9ac7-ab3119a69b5b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.275861] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee88b1ac-7274-488f-811f-76264a05e9f0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.276167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee88b1ac-7274-488f-811f-76264a05e9f0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.276167] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee88b1ac-7274-488f-811f-76264a05e9f0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.276248] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee88b1ac-7274-488f-811f-76264a05e9f0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.276248] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee88b1ac-7274-488f-811f-76264a05e9f0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.777822] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40652021-5874-414e-9ac7-ab3119a69b5b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.781500] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-40652021-5874-414e-9ac7-ab3119a69b5b taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.781500] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.781500] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee88b1ac-7274-488f-811f-76264a05e9f0 with status ACTIVE [ 1218.781785] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.781785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.781785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.781894] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.782542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.782542] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.782542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.782542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.782542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.782542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.782786] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.782786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.782899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.782990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.783058] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.783131] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee88b1ac-7274-488f-811f-76264a05e9f0 is going to be updated. [ 1218.802431] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.802431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.802606] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.802728] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.802844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.803011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee88b1ac-7274-488f-811f-76264a05e9f0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.281757] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40652021-5874-414e-9ac7-ab3119a69b5b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.786277] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.786470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.786470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.786699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.786833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.786943] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40652021-5874-414e-9ac7-ab3119a69b5b is going to be created. [ 1219.809573] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.809746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.809857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.810100] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.810263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.819056] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40652021-5874-414e-9ac7-ab3119a69b5b in Status: UNINITIALIZED for 2s [ 1221.830223] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40652021-5874-414e-9ac7-ab3119a69b5b in Status: SUCCESS [ 1221.830598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.830598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.830808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.830959] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.831210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.831210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.831334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.831388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.831534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.831610] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40652021-5874-414e-9ac7-ab3119a69b5b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.333356] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40652021-5874-414e-9ac7-ab3119a69b5b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.836666] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40652021-5874-414e-9ac7-ab3119a69b5b: rpc.has_security_group_logging(os_id): False [ 1222.854167] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.854308] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.854378] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.854587] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.854676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.854911] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.855017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.855087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.855237] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.855311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.855395] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40652021-5874-414e-9ac7-ab3119a69b5b is going to be created. [ 1222.907770] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.907999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.907999] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.908216] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.908397] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.918418] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40652021-5874-414e-9ac7-ab3119a69b5b in Status: IN_PROGRESS for 2s [ 1223.271547] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1223.271761] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1224.931319] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40652021-5874-414e-9ac7-ab3119a69b5b in Status: SUCCESS [ 1224.931694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.273044] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1228.273365] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1230.015384] env[69637]: INFO networking_nsxv3.common.synchronization [req-3a816b11-39b6-42c9-9a88-14d5e947c074 req-8c71d096-2765-4898-8543-a2d96227bbe2 tempest-ServerActionsTestJSON-2076172663 tempest-ServerActionsTestJSON-2076172663-project-member] Enqueued Resource ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 with Priority: HIGHEST for action security_group_members [ 1230.015898] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 with Priority: HIGHEST for action security_group_members [ 1230.016309] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-099916fa-5a16-4c59-8d82-c524401ffcf2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.016434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.016527] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.017038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.017038] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.017038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.017038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.017339] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.017382] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.017498] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('099916fa-5a16-4c59-8d82-c524401ffcf2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.520231] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.520427] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.520495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.520663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.520754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.520996] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.521122] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.521187] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.521338] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.521417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.521530] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 is going to be updated. [ 1230.547692] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.547920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.547986] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.548174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.548320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.556509] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 in Status: IN_PROGRESS for 2s [ 1232.151301] env[69637]: INFO networking_nsxv3.common.synchronization [req-6bc0b047-d799-44ee-b8c0-dd013287a89f req-2c1cca34-9fdf-4f01-8d1e-7f1678d4a032 tempest-DeleteServersTestJSON-1864882804 tempest-DeleteServersTestJSON-1864882804-project-member] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1232.151997] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1232.152206] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.152332] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.152398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.157072] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.157328] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.157490] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.157579] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.157809] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.157942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.161196] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.567918] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 in Status: SUCCESS [ 1232.568020] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 deletion is rescheduled due to dependency. [ 1232.568161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.664023] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.664232] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.664334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.664677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.664809] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.665093] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.665233] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.665333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.665519] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.665601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.665690] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1232.690901] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.691122] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.691122] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.691375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.691521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.699264] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1234.710180] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1234.710567] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 deletion is rescheduled due to dependency. [ 1234.710567] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.152865] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1237.153315] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1242.154313] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1242.154694] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1243.222383] env[69637]: INFO networking_nsxv3.common.synchronization [req-c199d4ad-0cb5-4662-bbdb-c947720b1e26 req-bb107fec-e12c-4237-9e88-15525c446f2a tempest-DeleteServersTestJSON-1864882804 tempest-DeleteServersTestJSON-1864882804-project-member] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1243.222920] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1243.223281] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.223405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.223473] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.223669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.223812] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.223908] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.223972] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.224267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.224357] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.224469] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.521281] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.521500] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.521626] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.521923] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.522234] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.522411] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.522535] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.522755] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.522908] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.523127] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1243.523244] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1243.523355] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1243.523467] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1243.524410] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1243.524410] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1243.524410] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1243.543270] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1243.543432] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1243.543573] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1243.543742] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.544041] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-8e0e2a1c-5239-4901-8280-92b9a377b030 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.544211] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-8e0e2a1c-5239-4901-8280-92b9a377b030" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.544334] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-8e0e2a1c-5239-4901-8280-92b9a377b030" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.544635] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-8e0e2a1c-5239-4901-8280-92b9a377b030" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.544773] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e0e2a1c-5239-4901-8280-92b9a377b030',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.726279] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.726442] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.726627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.726723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.726815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.727008] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.727117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.727179] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.727330] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.727412] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.727490] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1243.751196] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.751328] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.751372] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.751542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.751680] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.759536] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1244.047593] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.047593] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.047593] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.047899] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.047899] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.048028] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 8e0e2a1c-5239-4901-8280-92b9a377b030 not found, creating... [ 1244.048294] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.049058] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.049058] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.049058] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.049058] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.049246] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.049468] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.049468] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.049688] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.049825] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.050020] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 8e0e2a1c-5239-4901-8280-92b9a377b030 is going to be created. [ 1244.069522] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.069806] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.070070] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.070428] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.070735] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.071087] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-8e0e2a1c-5239-4901-8280-92b9a377b030" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.898347] env[69637]: INFO networking_nsxv3.common.synchronization [req-c199d4ad-0cb5-4662-bbdb-c947720b1e26 req-8e33464d-e8cf-46a4-aa4f-9dee3c6eb822 service nova] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_rules [ 1244.898640] env[69637]: INFO networking_nsxv3.common.synchronization [req-c199d4ad-0cb5-4662-bbdb-c947720b1e26 req-8e33464d-e8cf-46a4-aa4f-9dee3c6eb822 service nova] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1244.898640] env[69637]: INFO networking_nsxv3.common.synchronization [req-c199d4ad-0cb5-4662-bbdb-c947720b1e26 req-8e33464d-e8cf-46a4-aa4f-9dee3c6eb822 service nova] Enqueued Resource ID: 8e0e2a1c-5239-4901-8280-92b9a377b030 with Priority: HIGHEST for action port [ 1244.898815] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_rules [ 1244.899012] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1244.899120] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e0e2a1c-5239-4901-8280-92b9a377b030 with Priority: HIGHEST for action port [ 1244.899704] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.899840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.899931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.900154] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.900236] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.901088] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.901218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.901392] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e0e2a1c-5239-4901-8280-92b9a377b030 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.901492] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e0e2a1c-5239-4901-8280-92b9a377b030" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.901546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e0e2a1c-5239-4901-8280-92b9a377b030" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.901713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e0e2a1c-5239-4901-8280-92b9a377b030" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.901789] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e0e2a1c-5239-4901-8280-92b9a377b030',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.403665] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.403809] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.403999] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e0e2a1c-5239-4901-8280-92b9a377b030 with status ACTIVE [ 1245.404204] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.404397] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.404397] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.404637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.404687] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.404858] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.404953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.405024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.405173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.405620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.405620] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.405620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.405620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.405784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.405784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.405844] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e0e2a1c-5239-4901-8280-92b9a377b030 is going to be updated. [ 1245.424945] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.425095] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.425164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.425349] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.425477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.425628] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e0e2a1c-5239-4901-8280-92b9a377b030" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.769061] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1245.769254] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 deletion is rescheduled due to dependency. [ 1245.769367] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.769523] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.769735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.769952] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.770095] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.770157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.770313] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.770393] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.770512] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.273243] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.776898] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.278742] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.279083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.279083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.279303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.279428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.279537] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1247.307415] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.307415] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.307415] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.307672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.307762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.315625] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1249.325823] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1249.326108] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.326254] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.326486] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.326682] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.326796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.326860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.327014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.327103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.327185] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.327275] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.830293] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.830513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.830605] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.830915] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.831199] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.831340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.831447] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.831697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.831845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.832011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.832234] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.832391] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.832484] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.832707] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.832956] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.833107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.833184] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.833430] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.833569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.833691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.833856] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.899741] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1249.899965] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1250.336766] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7376d44-359d-46ab-85b9-78423d657c47: rpc.has_security_group_logging(os_id): False [ 1250.353196] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.353349] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.353421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.353637] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.353731] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.353913] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.354020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.354083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.354231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.354307] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.354489] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.354580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.354639] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.354774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.354847] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.355059] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.355155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.355215] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.355351] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.355426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.355508] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1250.415538] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.415758] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.415845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.416172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.416362] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.427936] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1252.441982] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1252.442377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.901140] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1254.901140] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1257.453209] env[69637]: INFO networking_nsxv3.common.synchronization [req-90c0a97a-df78-41d3-84b7-657085005b8a req-00a592eb-f4c5-44cf-867a-d33605a37932 tempest-ServerActionsTestOtherA-1708466346 tempest-ServerActionsTestOtherA-1708466346-project-member] Enqueued Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_members [ 1257.453922] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_members [ 1257.454262] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-69c7681d-644f-47c6-8228-9fc17f49b5a3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.454393] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.454912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.454912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.454912] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.455065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.455065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.455169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.455961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.455961] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.522016] env[69637]: INFO networking_nsxv3.common.synchronization [req-22601afb-4684-467d-a4dc-297a097c0f61 req-92f177e9-4a70-4127-b0a3-ab3f4dd0c9c2 tempest-DeleteServersTestJSON-1864882804 tempest-DeleteServersTestJSON-1864882804-project-member] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1257.522718] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1257.522995] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.523206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.523314] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.524370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.524571] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.524735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.524861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.525078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.525175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.525271] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.957720] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.027425] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.027571] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.027638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.027861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.028056] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.028269] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.028371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.028436] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.028597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.028677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.028762] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1258.056427] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.056576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.056647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.056829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.056964] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.064099] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1258.459716] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.962552] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.962823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.962823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.963031] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.963130] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.963225] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 is going to be updated. [ 1258.988327] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.988507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.988507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.988631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.988770] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.997465] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 in Status: IN_PROGRESS for 2s [ 1260.073662] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1260.074059] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 deletion is rescheduled due to dependency. [ 1260.074059] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.001329] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.001558] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.001702] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.001978] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.002264] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.002421] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.002556] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.002779] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.002928] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.003162] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1261.003289] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1261.003409] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1261.003522] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1261.003654] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1261.003770] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1261.003908] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1261.015013] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 in Status: SUCCESS [ 1261.015220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.025954] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1261.026130] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1261.026273] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1261.026436] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.026713] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-2363d49f-aa87-4174-857b-388a4221f960 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.026939] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.027064] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.027318] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.027460] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2363d49f-aa87-4174-857b-388a4221f960',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.529806] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.530170] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.530170] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.530448] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.530600] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.530878] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.531050] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.531175] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.531394] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.531533] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.531835] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.531996] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.532132] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.532342] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.532479] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.532624] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 2363d49f-aa87-4174-857b-388a4221f960 is going to be updated. [ 1261.552177] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.552177] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.552177] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.552177] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.552420] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.552519] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.252702] env[69637]: INFO networking_nsxv3.common.synchronization [req-7dc27567-33ae-46bc-a8db-f6e54814db0f req-726abc12-10d9-4982-80a8-68c2ca026779 service nova] Enqueued Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_rules [ 1262.252940] env[69637]: INFO networking_nsxv3.common.synchronization [req-7dc27567-33ae-46bc-a8db-f6e54814db0f req-726abc12-10d9-4982-80a8-68c2ca026779 service nova] Enqueued Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_members [ 1262.252940] env[69637]: INFO networking_nsxv3.common.synchronization [req-7dc27567-33ae-46bc-a8db-f6e54814db0f req-726abc12-10d9-4982-80a8-68c2ca026779 service nova] Enqueued Resource ID: 2363d49f-aa87-4174-857b-388a4221f960 with Priority: HIGHEST for action port [ 1262.253192] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_rules [ 1262.253326] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_members [ 1262.253420] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2363d49f-aa87-4174-857b-388a4221f960 with Priority: HIGHEST for action port [ 1262.254412] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43258334-5dc5-4214-9e8e-73f662ea7ef7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.254544] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.254608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.254804] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.254885] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.255674] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-43258334-5dc5-4214-9e8e-73f662ea7ef7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.255788] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.255854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.256028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.256173] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.256311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.256381] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.256460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.256542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.256630] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.257334] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-2363d49f-aa87-4174-857b-388a4221f960 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.257515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.257515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.257742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.257742] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2363d49f-aa87-4174-857b-388a4221f960',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.760063] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.761222] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-43258334-5dc5-4214-9e8e-73f662ea7ef7 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.761340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.761492] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2363d49f-aa87-4174-857b-388a4221f960 with status ACTIVE [ 1262.761647] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.761755] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.761841] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.762028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.762124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.762308] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.762411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.762475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.762643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.762722] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.762900] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.763066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.763284] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.763462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.763544] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.763631] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2363d49f-aa87-4174-857b-388a4221f960 is going to be updated. [ 1262.783944] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.784112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.784163] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.784380] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.784524] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.784680] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2363d49f-aa87-4174-857b-388a4221f960" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.266140] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.769246] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.769585] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.769585] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.769585] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.769683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.769730] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 is going to be updated. [ 1263.794684] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.794852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.794852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.796581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.796581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.803121] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 in Status: IN_PROGRESS for 2s [ 1265.317628] env[69637]: INFO networking_nsxv3.common.synchronization [req-2d8f4bd9-a52a-415f-8eb2-2db85ea6b0ad req-1d32128d-5489-4c9c-aab3-1bd54a53ebb7 tempest-AttachVolumeTestJSON-2085947096 tempest-AttachVolumeTestJSON-2085947096-project-member] Enqueued Resource ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 with Priority: HIGHEST for action security_group_members [ 1265.318233] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 with Priority: HIGHEST for action security_group_members [ 1265.318575] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-10bfbfef-dd2c-4f67-b745-daf1a2635347 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.318701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.320611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.320611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.320753] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.320952] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.320952] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.321142] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.321285] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.321328] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10bfbfef-dd2c-4f67-b745-daf1a2635347',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.812957] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 in Status: SUCCESS [ 1265.813198] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.813391] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.813624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.813840] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.813997] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.814127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.814391] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.814513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.814654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.814787] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.824030] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.824268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.824339] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.824702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.824817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.825034] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.825169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.825211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.825360] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.825437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.825525] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 is going to be updated. [ 1265.848973] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.849224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.849224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.849405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.849533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.857399] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 in Status: IN_PROGRESS for 2s [ 1266.320567] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.821431] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43258334-5dc5-4214-9e8e-73f662ea7ef7: rpc.has_security_group_logging(os_id): False [ 1266.840542] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.840769] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.840825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.841131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.841256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.841543] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.841664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.841768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.841987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.842079] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.842194] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 is going to be updated. [ 1266.932061] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.932061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.932061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.932061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.932061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.949045] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 in Status: IN_PROGRESS for 2s [ 1267.849102] env[69637]: INFO networking_nsxv3.common.synchronization [req-e6c7b4b3-6a8d-490d-b843-988639c6bca5 req-7a42bc7e-5b49-493b-ba9d-fde146d95d4d tempest-ServerActionsTestJSON-2076172663 tempest-ServerActionsTestJSON-2076172663-project-member] Enqueued Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 1267.849714] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 1267.850241] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.850411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.850534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.850815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.851113] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.851311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.851311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.851518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.851722] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.851722] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.873205] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 in Status: SUCCESS [ 1267.873474] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10bfbfef-dd2c-4f67-b745-daf1a2635347 deletion is rescheduled due to dependency. [ 1267.873607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10bfbfef-dd2c-4f67-b745-daf1a2635347" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.354514] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.354672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.354726] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.354954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.388174] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.388450] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.388651] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.388748] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.388968] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.389071] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.389164] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 is going to be updated. [ 1268.429777] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.430020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.430020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.430426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.430598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.449565] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: IN_PROGRESS for 2s [ 1268.963825] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 in Status: SUCCESS [ 1268.963825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.443912] env[69637]: INFO networking_nsxv3.common.synchronization [req-542c17e2-8ce7-4dba-bb25-de1a00da117c req-12653567-9fd3-4dc9-967e-4485f7489482 tempest-DeleteServersTestJSON-1864882804 tempest-DeleteServersTestJSON-1864882804-project-member] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1269.444764] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1269.445719] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.445719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.445719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.445719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.445947] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.446119] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.446196] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.446354] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.446441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.446539] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.739409] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.739409] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.739409] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.739409] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.739677] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.739744] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.739828] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.740121] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.740280] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.740496] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1269.740610] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1269.740722] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1269.740831] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1269.740944] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1269.741066] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1269.741202] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1269.759564] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1269.759751] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1269.759881] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1269.760213] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.760551] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-baf5c2d7-50c9-4237-9f14-f6487d9bd315 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.760733] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-baf5c2d7-50c9-4237-9f14-f6487d9bd315" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.760857] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-baf5c2d7-50c9-4237-9f14-f6487d9bd315" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.761215] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-baf5c2d7-50c9-4237-9f14-f6487d9bd315" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.761359] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baf5c2d7-50c9-4237-9f14-f6487d9bd315',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.949468] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.949719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.949719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.949924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.950065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.950268] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.950368] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.950431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.950607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.950680] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.950752] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1269.973567] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.973935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.973935] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.974013] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.974127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.983075] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1270.264235] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.264450] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.264540] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.264829] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.264984] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.265158] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port baf5c2d7-50c9-4237-9f14-f6487d9bd315 not found, creating... [ 1270.265425] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.265585] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.265702] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.265923] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.266074] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.266361] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.266519] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.266637] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.266846] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.266982] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.267144] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: baf5c2d7-50c9-4237-9f14-f6487d9bd315 is going to be created. [ 1270.285755] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.285921] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.286050] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.286280] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.286500] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.286710] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-baf5c2d7-50c9-4237-9f14-f6487d9bd315" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.458751] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: SUCCESS [ 1270.458886] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 deletion is rescheduled due to dependency. [ 1270.459012] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.987705] env[69637]: INFO networking_nsxv3.common.synchronization [req-542c17e2-8ce7-4dba-bb25-de1a00da117c req-064290f3-dea9-44e5-a5a7-d6eaf36b8146 service nova] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_rules [ 1270.988146] env[69637]: INFO networking_nsxv3.common.synchronization [req-542c17e2-8ce7-4dba-bb25-de1a00da117c req-064290f3-dea9-44e5-a5a7-d6eaf36b8146 service nova] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1270.988200] env[69637]: INFO networking_nsxv3.common.synchronization [req-542c17e2-8ce7-4dba-bb25-de1a00da117c req-064290f3-dea9-44e5-a5a7-d6eaf36b8146 service nova] Enqueued Resource ID: baf5c2d7-50c9-4237-9f14-f6487d9bd315 with Priority: HIGHEST for action port [ 1270.988840] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_rules [ 1270.989143] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1270.989143] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baf5c2d7-50c9-4237-9f14-f6487d9bd315 with Priority: HIGHEST for action port [ 1270.989364] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.989512] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.989622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.989858] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.989965] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.991133] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.991133] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.991346] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-baf5c2d7-50c9-4237-9f14-f6487d9bd315 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.991482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-baf5c2d7-50c9-4237-9f14-f6487d9bd315" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.991636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-baf5c2d7-50c9-4237-9f14-f6487d9bd315" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.991791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-baf5c2d7-50c9-4237-9f14-f6487d9bd315" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.991891] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baf5c2d7-50c9-4237-9f14-f6487d9bd315',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.493604] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.493744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.495205] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port baf5c2d7-50c9-4237-9f14-f6487d9bd315 with status ACTIVE [ 1271.495441] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.495574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.495612] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.495832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.495927] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.496134] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.496242] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.496304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.496463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.496546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.496985] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.496985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.496985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.496985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.497207] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.497207] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: baf5c2d7-50c9-4237-9f14-f6487d9bd315 is going to be updated. [ 1271.519204] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.519379] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.519423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.519610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.519747] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.519906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-baf5c2d7-50c9-4237-9f14-f6487d9bd315" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.994478] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1271.994840] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 deletion is rescheduled due to dependency. [ 1271.994840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.994972] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.995311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.995519] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.995642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.995708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.995867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.995950] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.996090] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.499229] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.001814] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.504178] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.504346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.504420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.504641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.504739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.504832] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1273.536925] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.537116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.537198] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.537338] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.537478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.546268] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1275.556337] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1275.556620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.556803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.557034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.557228] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.557348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.557413] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.557565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.557642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.557726] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.557814] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.990430] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1275.990622] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1276.060271] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.060473] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.060473] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.060677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.060842] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.060942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.061020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.061176] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.061266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.061356] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.061516] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.061675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.061786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.061958] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.062151] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.062279] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.062380] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.062550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.062701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.062822] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.062936] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.565675] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7376d44-359d-46ab-85b9-78423d657c47: rpc.has_security_group_logging(os_id): False [ 1276.582569] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.582825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.582920] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.583190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.583309] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.583537] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.583666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.583733] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.583922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.584012] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.584231] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.584341] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.584404] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.584580] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.584658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.584885] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.584997] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.585076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.585235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.585311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.585415] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1276.651823] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.652091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.652091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.652270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.652727] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.667102] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1278.232491] env[69637]: INFO networking_nsxv3.common.synchronization [req-7527904f-a1ba-45ce-b524-7b89b5680131 req-1e0fad3b-f2a5-4c21-8618-e1e06c3e2474 tempest-ServerActionsTestJSON-2076172663 tempest-ServerActionsTestJSON-2076172663-project-member] Enqueued Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 1278.232927] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 1278.233239] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.233359] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.233421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.233614] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.233757] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.233853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.233909] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.234199] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.234297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.234391] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.500522] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-970 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.500690] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.500819] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.501115] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.501384] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.501552] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.501696] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.501920] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.502098] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.502336] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1278.502451] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1278.502563] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1278.502671] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1278.502783] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1278.502892] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1278.503054] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1278.526336] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1278.526504] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1278.526646] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1278.526861] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.527322] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-08f05a65-03c6-482d-9df8-dddd0a0d57be taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.527550] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-08f05a65-03c6-482d-9df8-dddd0a0d57be" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.527681] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-08f05a65-03c6-482d-9df8-dddd0a0d57be" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.527987] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-08f05a65-03c6-482d-9df8-dddd0a0d57be" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.528148] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08f05a65-03c6-482d-9df8-dddd0a0d57be',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.681134] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1278.681396] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.736793] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.737028] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.737091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.737306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.737400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.737616] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.737698] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.737764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.737906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.738015] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.738127] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 is going to be updated. [ 1278.762454] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.762682] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.762768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.763116] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.763290] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.772223] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: IN_PROGRESS for 2s [ 1278.990156] env[69637]: INFO networking_nsxv3.common.synchronization [req-d95f2704-5da6-44a6-8bb3-11be71e5d5a1 req-4af8bebd-73e3-473b-86a2-9fb9ef4cc494 tempest-ServerActionsTestOtherA-1708466346 tempest-ServerActionsTestOtherA-1708466346-project-member] Enqueued Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_members [ 1278.990746] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 with Priority: HIGHEST for action security_group_members [ 1278.991130] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-69c7681d-644f-47c6-8228-9fc17f49b5a3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.991305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.991437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.991712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.992021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.992203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.992306] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.992573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.992690] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.992847] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69c7681d-644f-47c6-8228-9fc17f49b5a3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.030715] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.030951] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.034083] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.034083] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.034083] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.034083] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 08f05a65-03c6-482d-9df8-dddd0a0d57be not found, creating... [ 1279.035182] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.035182] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.035182] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.035182] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.035925] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.037214] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.037416] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.037547] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.037778] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.037922] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.038084] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 08f05a65-03c6-482d-9df8-dddd0a0d57be is going to be created. [ 1279.059247] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.059478] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.059614] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.059908] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.060200] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.060449] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-08f05a65-03c6-482d-9df8-dddd0a0d57be" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.495694] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.496041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.496169] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.496538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.496683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.496898] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.497026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.497092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.497262] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.497348] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.497439] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 is going to be updated. [ 1279.525580] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.527017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.527017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.527017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.527017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.536226] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 in Status: IN_PROGRESS for 2s [ 1279.901545] env[69637]: INFO networking_nsxv3.common.synchronization [req-7527904f-a1ba-45ce-b524-7b89b5680131 req-ad38db74-72c1-4c61-9f65-9efba80beee2 service nova] Enqueued Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_rules [ 1279.901736] env[69637]: INFO networking_nsxv3.common.synchronization [req-7527904f-a1ba-45ce-b524-7b89b5680131 req-ad38db74-72c1-4c61-9f65-9efba80beee2 service nova] Enqueued Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 1279.901944] env[69637]: INFO networking_nsxv3.common.synchronization [req-7527904f-a1ba-45ce-b524-7b89b5680131 req-ad38db74-72c1-4c61-9f65-9efba80beee2 service nova] Enqueued Resource ID: 08f05a65-03c6-482d-9df8-dddd0a0d57be with Priority: HIGHEST for action port [ 1279.902188] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_rules [ 1279.902248] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 1279.902349] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f05a65-03c6-482d-9df8-dddd0a0d57be with Priority: HIGHEST for action port [ 1279.902916] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.903102] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.903178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.903388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.903490] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.904405] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.904523] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.904721] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-08f05a65-03c6-482d-9df8-dddd0a0d57be taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.904821] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08f05a65-03c6-482d-9df8-dddd0a0d57be" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.905106] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08f05a65-03c6-482d-9df8-dddd0a0d57be" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.905283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08f05a65-03c6-482d-9df8-dddd0a0d57be" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.905363] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08f05a65-03c6-482d-9df8-dddd0a0d57be',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.997480] env[69637]: INFO networking_nsxv3.common.synchronization [req-9779c8e2-45a8-4347-b3b2-6e4393a5e63d req-2aaadbe7-e3a0-4a45-b0ad-aa32cdf9f4e9 tempest-AttachVolumeNegativeTest-994548743 tempest-AttachVolumeNegativeTest-994548743-project-member] Enqueued Resource ID: 40652021-5874-414e-9ac7-ab3119a69b5b with Priority: HIGHEST for action security_group_members [ 1279.997480] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40652021-5874-414e-9ac7-ab3119a69b5b with Priority: HIGHEST for action security_group_members [ 1279.997866] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-40652021-5874-414e-9ac7-ab3119a69b5b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.997987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.998076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.998296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.998438] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.998547] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.998649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.998719] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.998791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.999092] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40652021-5874-414e-9ac7-ab3119a69b5b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.407080] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.407080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.409417] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08f05a65-03c6-482d-9df8-dddd0a0d57be with status ACTIVE [ 1280.409603] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.409715] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.409818] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.410011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.410148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.410380] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.410431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.410493] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.410668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.410798] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.410883] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.410961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.411070] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.411220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.411275] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.411333] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08f05a65-03c6-482d-9df8-dddd0a0d57be is going to be updated. [ 1280.430759] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.430947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.430947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.431163] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.431253] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.431375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08f05a65-03c6-482d-9df8-dddd0a0d57be" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.501030] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.501296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.501371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.501615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.501732] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.502065] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.502219] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.502264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.502428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.502517] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.502606] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40652021-5874-414e-9ac7-ab3119a69b5b is going to be updated. [ 1280.541288] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.541288] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.541497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.541543] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.541711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.552221] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40652021-5874-414e-9ac7-ab3119a69b5b in Status: IN_PROGRESS for 2s [ 1280.782014] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: SUCCESS [ 1280.782204] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 deletion is rescheduled due to dependency. [ 1280.782320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.782478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.782685] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.782861] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.782970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.783041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.783198] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.783274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.783363] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.285574] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.548446] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 in Status: SUCCESS [ 1281.548446] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69c7681d-644f-47c6-8228-9fc17f49b5a3 deletion is rescheduled due to dependency. [ 1281.548446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69c7681d-644f-47c6-8228-9fc17f49b5a3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.788399] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.292575] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.292739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.292811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.293044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.293135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.293240] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 is going to be updated. [ 1282.325643] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.325790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.325857] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.326081] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.326263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.333757] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: IN_PROGRESS for 2s [ 1282.562426] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40652021-5874-414e-9ac7-ab3119a69b5b in Status: SUCCESS [ 1282.562426] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40652021-5874-414e-9ac7-ab3119a69b5b deletion is rescheduled due to dependency. [ 1282.562426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.609730] env[69637]: INFO networking_nsxv3.common.synchronization [req-6de77e37-3640-477b-8e0b-42db57897b81 req-62ae6b55-4cf0-47f0-80b1-8b13252d4179 tempest-DeleteServersTestJSON-1864882804 tempest-DeleteServersTestJSON-1864882804-project-member] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1282.610283] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1282.610584] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.610702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.610768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.610966] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.611158] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.611256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.611457] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.611612] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.611696] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.611790] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.114219] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.114380] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.114438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.114654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.114744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.114934] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.115048] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.115114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.115266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.115343] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.115429] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1283.142576] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.142703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.142811] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.142959] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.143114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.150859] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1284.343719] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: SUCCESS [ 1284.344041] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.344093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.344278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.344466] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.344571] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.344658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.344776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.344855] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.344939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.345039] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.847787] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.161071] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1285.161071] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 deletion is rescheduled due to dependency. [ 1285.161071] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.352477] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6b27dfc-30ce-43c0-922c-60d619d56e60: rpc.has_security_group_logging(os_id): False [ 1285.370275] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.370479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.370527] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.370728] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.370816] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.371093] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.371216] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.371332] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.371465] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.371514] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.371563] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 is going to be updated. [ 1285.427239] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.427395] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.427517] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.427704] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.427837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.437819] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: IN_PROGRESS for 2s [ 1287.240521] env[69637]: INFO networking_nsxv3.common.synchronization [None req-bdc29cea-bdf2-491e-bf34-26d556c26091 None None] Enqueued Resource ID: 49eb0442-7c28-463d-9824-c82441de26b1 with Priority: HIGHEST for action port [ 1287.240818] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49eb0442-7c28-463d-9824-c82441de26b1 with Priority: HIGHEST for action port [ 1287.241385] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-49eb0442-7c28-463d-9824-c82441de26b1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.241515] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49eb0442-7c28-463d-9824-c82441de26b1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.241567] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49eb0442-7c28-463d-9824-c82441de26b1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.241817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49eb0442-7c28-463d-9824-c82441de26b1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.241930] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49eb0442-7c28-463d-9824-c82441de26b1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.450704] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: SUCCESS [ 1287.450902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.745412] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49eb0442-7c28-463d-9824-c82441de26b1 [ 1287.745786] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.746724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.747353] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.749235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.749235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.749235] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49eb0442-7c28-463d-9824-c82441de26b1 already deleted. [ 1287.749235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49eb0442-7c28-463d-9824-c82441de26b1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.929833] env[69637]: INFO networking_nsxv3.common.synchronization [None req-f3228358-2b55-432c-b1c1-6a9549b8376f None None] Enqueued Resource ID: 892a9397-fcb1-49f1-8ec1-9e8431a5b1d4 with Priority: HIGHEST for action port [ 1288.930151] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 892a9397-fcb1-49f1-8ec1-9e8431a5b1d4 with Priority: HIGHEST for action port [ 1288.930799] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-892a9397-fcb1-49f1-8ec1-9e8431a5b1d4 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.931022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-892a9397-fcb1-49f1-8ec1-9e8431a5b1d4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.931120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-892a9397-fcb1-49f1-8ec1-9e8431a5b1d4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.931387] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-892a9397-fcb1-49f1-8ec1-9e8431a5b1d4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.931473] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('892a9397-fcb1-49f1-8ec1-9e8431a5b1d4',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.379805] env[69637]: INFO networking_nsxv3.common.synchronization [None req-586b68d3-7182-4bbd-a6a4-bb846f8c86df None None] Enqueued Resource ID: f5458f27-396b-425e-8408-a94fd2e46df2 with Priority: HIGHEST for action port [ 1289.380101] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5458f27-396b-425e-8408-a94fd2e46df2 with Priority: HIGHEST for action port [ 1289.380703] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5458f27-396b-425e-8408-a94fd2e46df2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.380828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5458f27-396b-425e-8408-a94fd2e46df2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.380896] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5458f27-396b-425e-8408-a94fd2e46df2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.381179] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5458f27-396b-425e-8408-a94fd2e46df2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.381263] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5458f27-396b-425e-8408-a94fd2e46df2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.434015] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 892a9397-fcb1-49f1-8ec1-9e8431a5b1d4 [ 1289.435266] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.435408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.436622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.436622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.436622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.436622] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:892a9397-fcb1-49f1-8ec1-9e8431a5b1d4 already deleted. [ 1289.436622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-892a9397-fcb1-49f1-8ec1-9e8431a5b1d4" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.883306] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5458f27-396b-425e-8408-a94fd2e46df2 [ 1289.883551] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.883653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.883834] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.883930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.884089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.884145] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5458f27-396b-425e-8408-a94fd2e46df2 already deleted. [ 1289.884209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5458f27-396b-425e-8408-a94fd2e46df2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.364112] env[69637]: INFO networking_nsxv3.common.synchronization [req-7afd873d-15aa-402e-abfa-bafcce4cdb22 req-7610c71a-6154-470c-9368-8ebee125d895 tempest-DeleteServersTestJSON-1864882804 tempest-DeleteServersTestJSON-1864882804-project-member] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1291.364112] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1291.364112] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.364112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.364112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.364112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.364112] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.364112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.364112] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.364784] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.364960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.365161] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.604348] env[69637]: INFO networking_nsxv3.common.synchronization [None req-4d5f6dc0-0fbd-46fc-804f-5ce60bed524f None None] Enqueued Resource ID: 74684087-888a-4930-b0c8-3f116d82b313 with Priority: HIGHEST for action port [ 1291.604348] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74684087-888a-4930-b0c8-3f116d82b313 with Priority: HIGHEST for action port [ 1291.604775] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-74684087-888a-4930-b0c8-3f116d82b313 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.604889] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74684087-888a-4930-b0c8-3f116d82b313" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.604955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74684087-888a-4930-b0c8-3f116d82b313" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.605202] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74684087-888a-4930-b0c8-3f116d82b313" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.605278] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74684087-888a-4930-b0c8-3f116d82b313',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.670466] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.670730] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.670922] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.671327] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.671693] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.671938] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.672177] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.672481] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.672734] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.673078] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1291.673246] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1291.673414] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1291.673556] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1291.673681] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1291.673795] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1291.674109] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1291.691818] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1291.691991] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1291.692127] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1291.692295] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-821" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.692576] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-623b6c71-9546-445f-beed-0cde0ea69ce0 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.692729] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-623b6c71-9546-445f-beed-0cde0ea69ce0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.692849] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-623b6c71-9546-445f-beed-0cde0ea69ce0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.693149] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-623b6c71-9546-445f-beed-0cde0ea69ce0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.693292] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('623b6c71-9546-445f-beed-0cde0ea69ce0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.868084] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.868248] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.868319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.868533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.868625] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.868813] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.868906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.869014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.869127] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.869203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.869289] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1291.892633] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.892795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.892866] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.893085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.893237] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.901609] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1292.108954] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74684087-888a-4930-b0c8-3f116d82b313 [ 1292.108954] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.108954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.108954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.108954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.108954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.108954] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74684087-888a-4930-b0c8-3f116d82b313 already deleted. [ 1292.108954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74684087-888a-4930-b0c8-3f116d82b313" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.195749] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.195975] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.196117] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.196466] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.196526] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.197167] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 623b6c71-9546-445f-beed-0cde0ea69ce0 not found, creating... [ 1292.197167] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.197167] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.197363] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.197440] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.197579] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.197864] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.198085] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.198217] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.198365] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.198514] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.198644] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 623b6c71-9546-445f-beed-0cde0ea69ce0 is going to be created. [ 1292.217263] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.217472] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.217603] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.217878] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.218124] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.218351] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-623b6c71-9546-445f-beed-0cde0ea69ce0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.910309] env[69637]: INFO networking_nsxv3.common.synchronization [req-7afd873d-15aa-402e-abfa-bafcce4cdb22 req-6250c4c2-76a1-4009-b122-e634d952db10 service nova] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_rules [ 1292.910707] env[69637]: INFO networking_nsxv3.common.synchronization [req-7afd873d-15aa-402e-abfa-bafcce4cdb22 req-6250c4c2-76a1-4009-b122-e634d952db10 service nova] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1292.911013] env[69637]: INFO networking_nsxv3.common.synchronization [req-7afd873d-15aa-402e-abfa-bafcce4cdb22 req-6250c4c2-76a1-4009-b122-e634d952db10 service nova] Enqueued Resource ID: 623b6c71-9546-445f-beed-0cde0ea69ce0 with Priority: HIGHEST for action port [ 1292.911913] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_rules [ 1292.912229] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1292.912412] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 623b6c71-9546-445f-beed-0cde0ea69ce0 with Priority: HIGHEST for action port [ 1292.912988] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.914050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.914050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.914050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.914050] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.915239] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.915417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.915564] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-623b6c71-9546-445f-beed-0cde0ea69ce0 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.915665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-623b6c71-9546-445f-beed-0cde0ea69ce0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.915733] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-623b6c71-9546-445f-beed-0cde0ea69ce0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.916094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-623b6c71-9546-445f-beed-0cde0ea69ce0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.916303] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('623b6c71-9546-445f-beed-0cde0ea69ce0',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.418534] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.418763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.418847] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 623b6c71-9546-445f-beed-0cde0ea69ce0 with status ACTIVE [ 1293.419020] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.419133] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.419204] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.419419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.419503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.419666] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.419753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.419812] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.419954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.420040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.421018] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.421018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.421018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.421018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.421018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.421018] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 623b6c71-9546-445f-beed-0cde0ea69ce0 is going to be updated. [ 1293.447839] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.447839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.447839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.447839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.447839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.447839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-623b6c71-9546-445f-beed-0cde0ea69ce0" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.910201] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1293.910376] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 deletion is rescheduled due to dependency. [ 1293.910615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.910656] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.910856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.911172] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.911172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.911283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.911385] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.911441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.911524] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.413910] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.739097] env[69637]: INFO networking_nsxv3.common.synchronization [req-2994e997-9eef-4836-8d8d-6a3ee6a8f941 req-5e9eab6d-358c-4419-ad47-7abec5f42025 tempest-ServersNegativeTestMultiTenantJSON-890438072 tempest-ServersNegativeTestMultiTenantJSON-890438072-project-member] Enqueued Resource ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 with Priority: HIGHEST for action security_group_members [ 1294.739845] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 with Priority: HIGHEST for action security_group_members [ 1294.739996] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.740137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.740223] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.741128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.741128] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.741128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.741128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.741128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.741128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.741128] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.920647] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.058517] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-499 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.058780] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-499" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.058939] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-499" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.059363] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-499" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.059680] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.059851] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.059974] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.060253] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.060466] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.060750] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1295.060907] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1295.061089] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1295.061260] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1295.061422] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1295.061575] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1295.061752] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1295.085857] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1295.086068] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1295.086213] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1295.086396] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-499" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.086745] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-354682d9-5cbe-4d50-bd54-011b5ffa9cd3 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.086938] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-354682d9-5cbe-4d50-bd54-011b5ffa9cd3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.087133] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-354682d9-5cbe-4d50-bd54-011b5ffa9cd3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.087492] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-354682d9-5cbe-4d50-bd54-011b5ffa9cd3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.087643] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('354682d9-5cbe-4d50-bd54-011b5ffa9cd3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.245527] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.245713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.245776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.245990] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.246095] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.246298] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.246424] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.246501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.246694] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.246776] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.246873] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 already deleted. [ 1295.246993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.424286] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.424460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.424536] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.424746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.424835] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.424930] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1295.449317] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.449501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.449577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.449791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.449938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.458966] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1295.590742] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.590951] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.591100] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.591443] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.591597] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.591756] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 354682d9-5cbe-4d50-bd54-011b5ffa9cd3 not found, creating... [ 1295.592013] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.592180] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.592306] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.592525] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.592663] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.592946] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.593553] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.593758] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.594088] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.594275] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.594459] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 354682d9-5cbe-4d50-bd54-011b5ffa9cd3 is going to be created. [ 1295.613274] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.613549] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.613709] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.613988] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.614337] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.614603] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-354682d9-5cbe-4d50-bd54-011b5ffa9cd3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.286694] env[69637]: INFO networking_nsxv3.common.synchronization [req-2994e997-9eef-4836-8d8d-6a3ee6a8f941 req-f5be19ee-2b91-4691-8dd1-eb14e114798e service nova] Enqueued Resource ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 with Priority: HIGHEST for action security_group_rules [ 1296.286949] env[69637]: INFO networking_nsxv3.common.synchronization [req-2994e997-9eef-4836-8d8d-6a3ee6a8f941 req-f5be19ee-2b91-4691-8dd1-eb14e114798e service nova] Enqueued Resource ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 with Priority: HIGHEST for action security_group_members [ 1296.287034] env[69637]: INFO networking_nsxv3.common.synchronization [req-2994e997-9eef-4836-8d8d-6a3ee6a8f941 req-f5be19ee-2b91-4691-8dd1-eb14e114798e service nova] Enqueued Resource ID: 354682d9-5cbe-4d50-bd54-011b5ffa9cd3 with Priority: HIGHEST for action port [ 1296.287543] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 with Priority: HIGHEST for action security_group_rules [ 1296.287701] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 with Priority: HIGHEST for action security_group_members [ 1296.287774] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354682d9-5cbe-4d50-bd54-011b5ffa9cd3 with Priority: HIGHEST for action port [ 1296.288084] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.288228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.288297] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.288545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.288629] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.289452] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.289577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.289629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.289791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.289932] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.290652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.290652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.290652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.290652] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.290652] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.291131] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-354682d9-5cbe-4d50-bd54-011b5ffa9cd3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.291304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-354682d9-5cbe-4d50-bd54-011b5ffa9cd3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.291406] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-354682d9-5cbe-4d50-bd54-011b5ffa9cd3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.291978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-354682d9-5cbe-4d50-bd54-011b5ffa9cd3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.292090] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('354682d9-5cbe-4d50-bd54-011b5ffa9cd3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.794812] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.794812] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.795039] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.795779] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 354682d9-5cbe-4d50-bd54-011b5ffa9cd3 with status ACTIVE [ 1296.795961] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.796078] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.796144] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.796347] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.796437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.796602] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.796696] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.796758] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.796917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.796994] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.797181] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.797273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.797335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.797469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.797542] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.797624] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 354682d9-5cbe-4d50-bd54-011b5ffa9cd3 is going to be updated. [ 1296.819261] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.819261] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.819414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.819504] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.819629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.819795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-354682d9-5cbe-4d50-bd54-011b5ffa9cd3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.300123] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.468208] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1297.468460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.468582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.468806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.468995] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.469123] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.469190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.469339] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.469419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.469505] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.469595] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.802546] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.802720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.802797] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.803021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.803117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.803216] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 is going to be created. [ 1297.826644] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.826796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.826870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.827118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.827292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.836167] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 in Status: UNINITIALIZED for 2s [ 1297.971926] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.972134] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.972206] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.972424] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.972616] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.972715] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.972780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.972947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.973061] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.973152] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.973296] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.973469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.973469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.973653] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.973800] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.973893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.973955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.974141] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.974221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.974305] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.974410] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.476821] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7376d44-359d-46ab-85b9-78423d657c47: rpc.has_security_group_logging(os_id): False [ 1298.493471] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.493641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.493708] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.493877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.493964] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.494163] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.494282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.494387] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.494552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.494631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.494811] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.494906] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.494968] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.495118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.495192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.495387] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.495482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.495544] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.495679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.495752] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.495835] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1298.551124] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.551250] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.551322] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.551507] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.551647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.564213] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1299.844624] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 in Status: SUCCESS [ 1299.844918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.844988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.845213] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.845394] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.845506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.845570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.845714] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.845795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.845879] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.845967] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.348223] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.348446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.348514] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.348689] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.348854] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.348997] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.348997] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.349675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.349675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.349675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.349675] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.349675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.349675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.349955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.349955] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.350044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.350044] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.350177] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.350317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.350434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.351232] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.577030] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1300.577274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.852798] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7: rpc.has_security_group_logging(os_id): False [ 1300.872040] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.872040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.872040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.872040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.872040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.872040] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.872040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.872455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.872455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.872455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.872549] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.872666] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.872712] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.872836] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.872982] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.873119] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.873219] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.873273] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.873423] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.873499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.873584] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 is going to be created. [ 1300.929802] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.930064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.930064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.930244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.930446] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.941554] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 in Status: IN_PROGRESS for 2s [ 1301.288562] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1301.288682] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1302.953788] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 in Status: SUCCESS [ 1302.954034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.289244] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1306.289517] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1307.471071] env[69637]: INFO networking_nsxv3.common.synchronization [req-90ad696a-cdb5-4cc9-b393-332795e86c21 req-ee04914d-4a11-464a-a2a0-4a24a3d457b4 tempest-ServersNegativeTestMultiTenantJSON-890438072 tempest-ServersNegativeTestMultiTenantJSON-890438072-project-member] Enqueued Resource ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 with Priority: HIGHEST for action security_group_members [ 1307.471738] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 with Priority: HIGHEST for action security_group_members [ 1307.472071] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.472194] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.472260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.472450] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.472594] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.472691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.472753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.472889] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.472970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.473087] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.975763] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.975954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.976065] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.976316] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.976431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.976654] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.976781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.976852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.977039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.977133] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.977243] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 is going to be updated. [ 1308.007879] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.008032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.008405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.008405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.008539] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.016921] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 in Status: IN_PROGRESS for 2s [ 1309.633322] env[69637]: INFO networking_nsxv3.common.synchronization [req-39f66002-d9cd-4127-803d-568d92396170 req-c594e327-871a-4b54-8ad7-2ad6f1c25fb5 tempest-ServerActionsTestOtherB-2018875684 tempest-ServerActionsTestOtherB-2018875684-project-member] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1309.633928] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1309.634250] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.634374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.634438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.634632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.634810] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.634887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.634939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.635134] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.635210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.635261] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.026832] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 in Status: SUCCESS [ 1310.026929] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7 deletion is rescheduled due to dependency. [ 1310.026979] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9c5683c-4ffe-4e54-ba26-0e609f7ee2a7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.137403] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.137569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.137639] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.137862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.137954] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.138167] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.138270] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.138345] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.138499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.138577] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.138663] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 is going to be updated. [ 1310.164241] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.164398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.164441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.164648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.164790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.173015] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: IN_PROGRESS for 2s [ 1311.112722] env[69637]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1311.113020] env[69637]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-27a33b7b-1083-436b-b24d-3fa5cd7aebc7 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1312.183454] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: SUCCESS [ 1312.183874] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 deletion is rescheduled due to dependency. [ 1312.183874] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.635111] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1314.635378] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.066890] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.067064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.067121] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.067359] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.067473] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.570476] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.072980] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.575512] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1316.575647] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1317.348261] env[69637]: INFO networking_nsxv3.common.synchronization [req-c945270e-9067-4af1-ba5c-0300940e691f req-9ce651c0-1b81-47de-96e8-f2aeb131dfe3 tempest-ServerActionsTestOtherB-2018875684 tempest-ServerActionsTestOtherB-2018875684-project-member] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1317.348787] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1317.349113] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.349237] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.349301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.349493] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.349641] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.349793] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.349793] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.349983] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.350046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.350148] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.493511] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.493723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.493774] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.493969] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.505541] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1317.507676] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.508521] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1317.545214] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.545358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.545433] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.545599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.559804] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.560561] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1317.560638] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1317.560721] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1317.598955] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.599194] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.599194] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.599396] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.600755] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.600922] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1317.622559] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-680 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.622750] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.622876] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.623156] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.623413] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.623570] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.623686] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.623895] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.624085] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.624304] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1317.624421] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1317.624534] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1317.624643] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1317.624752] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1317.624858] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1317.624988] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1317.649830] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1317.650022] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1317.650142] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1317.650310] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.650631] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-40286812-d681-4fd0-b99e-da8b86ae7810 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.650802] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.650962] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.651292] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.651435] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40286812-d681-4fd0-b99e-da8b86ae7810',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.675975] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.676176] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.676244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.676400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.676706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.676991] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1317.752222] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.752369] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.752459] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.752646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.752978] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.753282] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1317.753378] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'099916fa-5a16-4c59-8d82-c524401ffcf2', '938515a1-124c-4a31-9c35-b1d93a6612b5', 'abc9ca0b-4c93-42fd-9003-750112e8dab1', '26287d78-a077-45b2-9f9c-fbff1368c591', '5b978e6a-7c34-4af8-a48f-77dd3db23234', '40652021-5874-414e-9ac7-ab3119a69b5b', '0c35ee80-fc38-4bea-b273-773d4bf4b918', '4dab7827-c31f-472b-b986-30803c457337', 'bac27816-ae12-436b-86da-6c4bbde7b2ac', '506fca2b-4bdc-418f-be44-db369f7e1332', '5fb52e9e-114d-48d5-9b9e-c3f299243e92', 'cc38a146-8a93-4507-a45a-aaf042f5e30b', '9ebf57d6-6da5-49a3-83b3-8e08d42464db', '77e45333-e861-4952-94f1-dfd9a9a2ed58', '15e5246e-0aad-4687-8222-4618f13b02fa', 'ab63da8d-6ab8-41b7-8884-d191739821cb', '2bea8a67-35df-45be-bf57-95c80494d7fe', 'bea2b18c-a273-43ed-b1a7-dfa5ed37a831', '67b79615-8ab9-4c90-bd99-6702f487431a', '156f33af-1675-4f7d-b99d-9e88f58f4cd2', 'dd2b09de-422b-44ae-9e68-cb7612ecfcc4', '2f55a00f-c3f8-407e-be41-257b4c01874f', '69c7681d-644f-47c6-8228-9fc17f49b5a3', 'cd49e970-a2bd-4385-a944-996895a3be86', 'c5de72fa-d001-40b6-8ce0-d5b858d8f9d0', '10bfbfef-dd2c-4f67-b745-daf1a2635347', '8d51299a-8425-4d04-b702-fb6eebeef65f', 'c7376d44-359d-46ab-85b9-78423d657c47', '7d92d6b5-2ff4-49ef-8464-4c34d82dd192', 'cb4ec7fa-0ee9-45eb-b97b-b5547993b8f2', '5e078c82-40fd-4661-9911-198585d187a7', '43258334-5dc5-4214-9e8e-73f662ea7ef7', 'f6b27dfc-30ce-43c0-922c-60d619d56e60', '726820b1-ac2b-45a1-aaf6-d2c41e47022a', '9d9cb429-99aa-4837-be4a-8fc93149f9fb', 'fb173e06-7b41-4fdf-ae0b-3bb378905a07', 'ed080368-c954-48e2-a0f1-c55ff7a728fd', 'd9c5683c-4ffe-4e54-ba26-0e609f7ee2a7', '9f700376-4f24-4ccd-a620-7a4e934d5a40', '0b0f42b1-da2a-4ae8-9a1c-a7cf533df77f', '5113e882-e54a-4682-8961-555e92283cef', '23bbf0c1-9856-41c8-b206-759ddb9f7695', 'fefafe98-8990-454a-a252-19be0a2a5042', 'ff9b407c-6313-458e-a95d-b00d9b8914d1'} {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1317.753497] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1317.771436] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.771564] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.771659] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.771796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.771876] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.771974] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1317.772058] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1317.772117] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1317.850681] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.850891] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.850968] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.851171] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.852334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.852604] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1317.852698] env[69637]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69637) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1317.852775] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1317.852836] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1317.852924] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1317.852993] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 with Priority: HIGH for action security_group_rules [ 1317.853090] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGH for action security_group_rules [ 1317.853155] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGH for action security_group_rules [ 1317.853262] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGH for action security_group_rules [ 1317.853318] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGH for action security_group_rules [ 1317.853362] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40652021-5874-414e-9ac7-ab3119a69b5b with Priority: HIGH for action security_group_rules [ 1317.853416] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGH for action security_group_rules [ 1317.853472] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGH for action security_group_rules [ 1317.853619] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGH for action security_group_rules [ 1317.853619] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGH for action security_group_rules [ 1317.853619] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGH for action security_group_rules [ 1317.853770] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc38a146-8a93-4507-a45a-aaf042f5e30b with Priority: HIGH for action security_group_rules [ 1317.853770] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGH for action security_group_rules [ 1317.853842] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 with Priority: HIGH for action security_group_rules [ 1317.853878] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15e5246e-0aad-4687-8222-4618f13b02fa with Priority: HIGH for action security_group_rules [ 1317.853947] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab63da8d-6ab8-41b7-8884-d191739821cb with Priority: HIGH for action security_group_rules [ 1317.853979] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2bea8a67-35df-45be-bf57-95c80494d7fe with Priority: HIGH for action security_group_rules [ 1317.854105] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 with Priority: HIGH for action security_group_rules [ 1317.854105] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 67b79615-8ab9-4c90-bd99-6702f487431a with Priority: HIGH for action security_group_rules [ 1317.854212] env[69637]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGH for action security_group_rules [ 1317.854326] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.854619] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.854736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.854930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.854991] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.873953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.874212] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.874212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.874356] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.874495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.874582] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.874676] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 is going to be updated. [ 1317.903656] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.903851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.903930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.904203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.904393] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.912969] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: IN_PROGRESS for 2s [ 1318.153658] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.153849] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.153986] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.154276] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.154427] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.154587] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 40286812-d681-4fd0-b99e-da8b86ae7810 not found, creating... [ 1318.154848] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.155161] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.155161] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.155340] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.155482] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.155763] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.156039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.156039] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.156250] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.156385] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.156526] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 40286812-d681-4fd0-b99e-da8b86ae7810 is going to be created. [ 1318.178861] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.179045] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.179176] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.179409] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.179632] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.179844] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.708795] env[69637]: INFO networking_nsxv3.common.synchronization [req-26267b37-9a8d-458c-b9a2-c6fb08956f74 req-bc5d1bda-829c-4d56-9c23-2adc421a0cbe tempest-AttachVolumeShelveTestJSON-1899433646 tempest-AttachVolumeShelveTestJSON-1899433646-project-member] Enqueued Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_members [ 1318.708795] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 with Priority: HIGHEST for action security_group_members [ 1318.708795] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 with Priority: HIGH for action security_group_rules [ 1318.708795] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGH for action security_group_rules [ 1318.708795] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 with Priority: HIGH for action security_group_rules [ 1318.708795] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e5246e-0aad-4687-8222-4618f13b02fa with Priority: HIGH for action security_group_rules [ 1318.710156] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 with Priority: HIGH for action security_group_rules [ 1318.710778] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b79615-8ab9-4c90-bd99-6702f487431a with Priority: HIGH for action security_group_rules [ 1318.710778] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 with Priority: HIGH for action security_group_rules [ 1318.710778] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bea8a67-35df-45be-bf57-95c80494d7fe with Priority: HIGH for action security_group_rules [ 1318.711072] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 with Priority: HIGH for action security_group_rules [ 1318.712100] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab63da8d-6ab8-41b7-8884-d191739821cb with Priority: HIGH for action security_group_rules [ 1318.712100] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db with Priority: HIGH for action security_group_rules [ 1318.712100] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc38a146-8a93-4507-a45a-aaf042f5e30b with Priority: HIGH for action security_group_rules [ 1318.712100] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 with Priority: HIGH for action security_group_rules [ 1318.712100] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506fca2b-4bdc-418f-be44-db369f7e1332 with Priority: HIGH for action security_group_rules [ 1318.712100] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac27816-ae12-436b-86da-6c4bbde7b2ac with Priority: HIGH for action security_group_rules [ 1318.712432] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40652021-5874-414e-9ac7-ab3119a69b5b with Priority: HIGH for action security_group_rules [ 1318.712656] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dab7827-c31f-472b-b986-30803c457337 with Priority: HIGH for action security_group_rules [ 1318.712884] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 with Priority: HIGH for action security_group_rules [ 1318.713103] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 with Priority: HIGH for action security_group_rules [ 1318.714017] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26287d78-a077-45b2-9f9c-fbff1368c591 with Priority: HIGH for action security_group_rules [ 1318.714017] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-43258334-5dc5-4214-9e8e-73f662ea7ef7 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.714017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.714017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.714017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.714443] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.714660] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.714817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.715079] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.719128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.719128] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43258334-5dc5-4214-9e8e-73f662ea7ef7',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.719128] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-099916fa-5a16-4c59-8d82-c524401ffcf2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.719128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.719128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.719128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.719128] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('099916fa-5a16-4c59-8d82-c524401ffcf2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.719128] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.719128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.719128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.719128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.719128] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.719128] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c35ee80-fc38-4bea-b273-773d4bf4b918 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.722096] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.722314] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.728264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.728264] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c35ee80-fc38-4bea-b273-773d4bf4b918',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.728264] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15e5246e-0aad-4687-8222-4618f13b02fa taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.728264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.728264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.728264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.728264] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15e5246e-0aad-4687-8222-4618f13b02fa',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.728264] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.728264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.728264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.728264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.728264] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('156f33af-1675-4f7d-b99d-9e88f58f4cd2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.730197] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67b79615-8ab9-4c90-bd99-6702f487431a taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.730501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.730695] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.732089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.732089] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67b79615-8ab9-4c90-bd99-6702f487431a',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.732777] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bea2b18c-a273-43ed-b1a7-dfa5ed37a831 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.732887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.732955] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.733468] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.733468] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bea2b18c-a273-43ed-b1a7-dfa5ed37a831',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.734260] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bea8a67-35df-45be-bf57-95c80494d7fe taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.734260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.734367] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.734461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.734536] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bea8a67-35df-45be-bf57-95c80494d7fe',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.735801] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77e45333-e861-4952-94f1-dfd9a9a2ed58 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.735914] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.736069] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.736235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.736311] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77e45333-e861-4952-94f1-dfd9a9a2ed58',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.737282] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab63da8d-6ab8-41b7-8884-d191739821cb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.737420] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.737493] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.737670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.737721] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab63da8d-6ab8-41b7-8884-d191739821cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.739053] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.739165] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.739302] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.739473] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.739865] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ebf57d6-6da5-49a3-83b3-8e08d42464db',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.740761] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc38a146-8a93-4507-a45a-aaf042f5e30b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.741062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.741155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.741309] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.741382] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc38a146-8a93-4507-a45a-aaf042f5e30b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.742499] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.742640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.742710] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.742937] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.743038] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fb52e9e-114d-48d5-9b9e-c3f299243e92',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.743937] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-506fca2b-4bdc-418f-be44-db369f7e1332 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.744201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.744201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.744300] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.744355] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('506fca2b-4bdc-418f-be44-db369f7e1332',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.745372] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bac27816-ae12-436b-86da-6c4bbde7b2ac taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.745493] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.745549] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.745735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.746402] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bac27816-ae12-436b-86da-6c4bbde7b2ac',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.747812] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40652021-5874-414e-9ac7-ab3119a69b5b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.747922] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.747965] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.748211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.748287] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40652021-5874-414e-9ac7-ab3119a69b5b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.749113] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dab7827-c31f-472b-b986-30803c457337 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.749220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.749282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.749753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.749851] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dab7827-c31f-472b-b986-30803c457337',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.751478] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b978e6a-7c34-4af8-a48f-77dd3db23234 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.751690] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.751753] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.751877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.751956] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b978e6a-7c34-4af8-a48f-77dd3db23234',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.753281] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-938515a1-124c-4a31-9c35-b1d93a6612b5 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.753411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.753475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.754692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.754692] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('938515a1-124c-4a31-9c35-b1d93a6612b5',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.755122] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26287d78-a077-45b2-9f9c-fbff1368c591 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.755260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.755329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.755447] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.756633] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26287d78-a077-45b2-9f9c-fbff1368c591',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.797022] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.797235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.797235] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.797428] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.799527] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.799527] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.800151] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.800277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.800953] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.801085] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.820928] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.821064] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ebf57d6-6da5-49a3-83b3-8e08d42464db is going to be deleted. [ 1318.822056] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.822278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.842867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.843012] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 506fca2b-4bdc-418f-be44-db369f7e1332 is going to be deleted. [ 1318.844157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.844362] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.866518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.866732] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c35ee80-fc38-4bea-b273-773d4bf4b918 is going to be deleted. [ 1318.867649] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.867861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.886118] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.886291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.893660] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.893775] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc38a146-8a93-4507-a45a-aaf042f5e30b is going to be deleted. [ 1318.894571] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.894780] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.894869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.894985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ebf57d6-6da5-49a3-83b3-8e08d42464db" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.963493] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.963713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.963713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.963963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.964071] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.964212] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-506fca2b-4bdc-418f-be44-db369f7e1332" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.986173] env[69637]: INFO networking_nsxv3.common.synchronization [req-c945270e-9067-4af1-ba5c-0300940e691f req-2a133d64-4ab1-4be8-aad5-50c99e309ee3 service nova] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_rules [ 1318.986173] env[69637]: INFO networking_nsxv3.common.synchronization [req-c945270e-9067-4af1-ba5c-0300940e691f req-2a133d64-4ab1-4be8-aad5-50c99e309ee3 service nova] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1318.986173] env[69637]: INFO networking_nsxv3.common.synchronization [req-c945270e-9067-4af1-ba5c-0300940e691f req-2a133d64-4ab1-4be8-aad5-50c99e309ee3 service nova] Enqueued Resource ID: 40286812-d681-4fd0-b99e-da8b86ae7810 with Priority: HIGHEST for action port [ 1318.986173] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.986173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.986173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.986173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.986173] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.987675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc38a146-8a93-4507-a45a-aaf042f5e30b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.987797] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_rules [ 1318.987943] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1318.988057] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40286812-d681-4fd0-b99e-da8b86ae7810 with Priority: HIGHEST for action port [ 1318.988629] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.988722] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.989304] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.989398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.989590] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-40286812-d681-4fd0-b99e-da8b86ae7810 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.990151] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.990229] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.990403] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.990486] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40286812-d681-4fd0-b99e-da8b86ae7810',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.993697] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.993810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.993881] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.994555] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.994658] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.994775] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c35ee80-fc38-4bea-b273-773d4bf4b918" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.258880] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.259111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.266494] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.266646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.266698] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.266884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.272036] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.272186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.278911] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.278911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.283805] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.283917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.307965] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.308213] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.308937] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.309053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.328191] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.328405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.329323] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.329421] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.330237] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.330333] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.331109] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.331234] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.331957] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.332066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.332702] env[69637]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1319.333171] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.333284] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.333956] env[69637]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1319.334379] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.334483] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.335197] env[69637]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1319.335697] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.335818] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.336510] env[69637]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1319.336937] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.337042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.337620] env[69637]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1319.337995] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.338104] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.338870] env[69637]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1319.339309] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.339556] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.339693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.339781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.340449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.340449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.340449] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 is going to be updated. [ 1319.341091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.341264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.360346] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.360465] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab63da8d-6ab8-41b7-8884-d191739821cb is going to be deleted. [ 1319.361223] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.361400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.379462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.379574] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dab7827-c31f-472b-b986-30803c457337 is going to be deleted. [ 1319.380361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.380553] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.381913] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.382054] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.382124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.382278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.382404] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.394557] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 in Status: IN_PROGRESS for 2s [ 1319.408765] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.408921] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bac27816-ae12-436b-86da-6c4bbde7b2ac is going to be deleted. [ 1319.409854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.410097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.440321] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.440473] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.443767] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.443889] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 099916fa-5a16-4c59-8d82-c524401ffcf2 is going to be deleted. [ 1319.444813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.445032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.446301] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.446404] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.479739] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.479820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.492425] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40286812-d681-4fd0-b99e-da8b86ae7810 with status ACTIVE [ 1319.492575] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.492679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.492785] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.493010] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.493090] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.493269] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.493381] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.493441] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.493567] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.493641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.493817] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.493907] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.493966] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.494119] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.494194] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.494285] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40286812-d681-4fd0-b99e-da8b86ae7810 is going to be updated. [ 1319.496304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.496419] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26287d78-a077-45b2-9f9c-fbff1368c591 is going to be deleted. [ 1319.497202] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.497372] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.526416] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.526416] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.526586] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.526678] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.526820] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.526988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.557841] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.557990] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 938515a1-124c-4a31-9c35-b1d93a6612b5 is going to be deleted. [ 1319.558819] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.559039] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.585641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.585775] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bea8a67-35df-45be-bf57-95c80494d7fe is going to be deleted. [ 1319.586690] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.586869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.614446] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.614615] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.669363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.669490] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67b79615-8ab9-4c90-bd99-6702f487431a is going to be deleted. [ 1319.670410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.670654] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.733593] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.733884] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fb52e9e-114d-48d5-9b9e-c3f299243e92 is going to be deleted. [ 1319.734519] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.734724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.746152] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.746264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.818671] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.818832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.856192] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.856329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.859551] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.859667] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.875313] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.875455] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bea2b18c-a273-43ed-b1a7-dfa5ed37a831 is going to be deleted. [ 1319.876338] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.876550] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.936574] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: SUCCESS [ 1319.936750] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 deletion is rescheduled due to dependency. [ 1319.936870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.937489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.937744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.937956] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.938109] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.938178] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.938370] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.938458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.938582] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.949104] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.949237] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40652021-5874-414e-9ac7-ab3119a69b5b is going to be deleted. [ 1319.950310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.950557] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.960537] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.960704] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.027032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.027136] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b978e6a-7c34-4af8-a48f-77dd3db23234 is going to be deleted. [ 1320.028020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.028203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.056344] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.056469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.083987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.084130] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77e45333-e861-4952-94f1-dfd9a9a2ed58 is going to be deleted. [ 1320.085033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.085246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.148956] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.149143] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 156f33af-1675-4f7d-b99d-9e88f58f4cd2 is going to be deleted. [ 1320.149987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.150218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.151741] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.151893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.165946] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.166096] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.230763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.230937] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15e5246e-0aad-4687-8222-4618f13b02fa is going to be deleted. [ 1320.231833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.232053] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.232145] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.232264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab63da8d-6ab8-41b7-8884-d191739821cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.232411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.232561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.232641] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.232781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dab7827-c31f-472b-b986-30803c457337" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.233259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.233416] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.233499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.233611] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bac27816-ae12-436b-86da-6c4bbde7b2ac" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.233736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.233875] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.233951] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.234077] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-099916fa-5a16-4c59-8d82-c524401ffcf2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.234198] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.234335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.234408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.234521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26287d78-a077-45b2-9f9c-fbff1368c591" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.234643] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.234778] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.234852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.234961] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67b79615-8ab9-4c90-bd99-6702f487431a" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.235091] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.235224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.235296] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.235403] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-938515a1-124c-4a31-9c35-b1d93a6612b5" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.235525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.235660] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.235732] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.235839] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bea8a67-35df-45be-bf57-95c80494d7fe" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.235957] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.236104] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.236177] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.236283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fb52e9e-114d-48d5-9b9e-c3f299243e92" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.236402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.236536] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.236608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.236711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bea2b18c-a273-43ed-b1a7-dfa5ed37a831" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.236829] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.236958] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.237042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.237147] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b978e6a-7c34-4af8-a48f-77dd3db23234" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.237266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.237398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.237472] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.237573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40652021-5874-414e-9ac7-ab3119a69b5b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.246284] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.246475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.246475] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.246639] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.246718] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.246830] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77e45333-e861-4952-94f1-dfd9a9a2ed58" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.255173] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.255298] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.255343] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.255485] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.255574] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.255693] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-156f33af-1675-4f7d-b99d-9e88f58f4cd2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.390308] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.390482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.390563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.390801] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.390852] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.390972] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15e5246e-0aad-4687-8222-4618f13b02fa" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.440527] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.943132] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.404489] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 in Status: SUCCESS [ 1321.404666] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43258334-5dc5-4214-9e8e-73f662ea7ef7 deletion is rescheduled due to dependency. [ 1321.404786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43258334-5dc5-4214-9e8e-73f662ea7ef7" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.448506] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.448506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.448506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.448506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.448506] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.448506] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 is going to be updated. [ 1321.473859] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.474026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.474080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.474277] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.474417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.482851] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: IN_PROGRESS for 2s [ 1323.307210] env[69637]: INFO networking_nsxv3.common.synchronization [None req-3c36c9b9-511d-45b7-97a5-ec15fa32d502 tempest-AttachVolumeShelveTestJSON-1899433646 tempest-AttachVolumeShelveTestJSON-1899433646-project-member] Enqueued Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_rules [ 1323.307733] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_rules [ 1323.308057] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b336412-26a4-430f-933f-4da7b1cc33cb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.308184] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.308350] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.308625] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.308712] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.376501] env[69637]: INFO networking_nsxv3.common.synchronization [None req-8f79117e-e104-4969-a4ef-c56c04229cd9 tempest-AttachVolumeShelveTestJSON-1899433646 tempest-AttachVolumeShelveTestJSON-1899433646-project-member] Enqueued Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_rules [ 1323.376994] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_rules [ 1323.377314] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b336412-26a4-430f-933f-4da7b1cc33cb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.377415] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.494264] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: SUCCESS [ 1323.494477] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.494632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.494850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.495045] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.495161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.495226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.495380] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.495457] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.495544] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.495634] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.827362] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.827566] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.827624] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.827830] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.827946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.828090] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b336412-26a4-430f-933f-4da7b1cc33cb already deleted. [ 1323.828200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.828377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.828545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.828615] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.997900] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.348850] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.349189] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.349189] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.349294] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.349383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.349480] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b336412-26a4-430f-933f-4da7b1cc33cb already deleted. [ 1324.349561] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.500675] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abc9ca0b-4c93-42fd-9003-750112e8dab1: rpc.has_security_group_logging(os_id): False [ 1324.517325] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.517497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.517541] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.517751] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.517851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.518157] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.518289] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.518384] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.518528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.518609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.518695] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 is going to be updated. [ 1324.574779] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.574919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.574992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.575214] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.575358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.586957] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: IN_PROGRESS for 2s [ 1326.600864] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: SUCCESS [ 1326.601221] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.601264] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.601459] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.601563] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.103620] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.103796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.103901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.104189] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.104395] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.104508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.104573] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.104736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.104825] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.104913] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.105009] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.607667] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.110235] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abc9ca0b-4c93-42fd-9003-750112e8dab1: rpc.has_security_group_logging(os_id): False [ 1328.127260] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.127470] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.127533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.127762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.127904] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.128229] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.128402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.128499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.128713] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.128828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.128966] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 is going to be updated. [ 1328.181366] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.181610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.181610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.181803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.181950] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.194024] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: IN_PROGRESS for 2s [ 1328.378436] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1328.378613] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1328.668769] env[69637]: INFO networking_nsxv3.common.synchronization [req-2b7c0f5c-8f4b-4d32-84b3-f3812784781e req-021e1477-0e5e-4bb7-ac14-dfcddf43de1c tempest-AttachVolumeShelveTestJSON-1899433646 tempest-AttachVolumeShelveTestJSON-1899433646-project-member] Enqueued Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_members [ 1328.669342] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_members [ 1328.669626] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b336412-26a4-430f-933f-4da7b1cc33cb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.669752] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.669819] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.670096] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.670250] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.670355] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.670404] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.670601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.670703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.670834] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.033973] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.034206] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.034334] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.035914] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.035914] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.035914] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.035914] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.035914] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.035914] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.035914] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1329.035914] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1329.036409] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1329.036409] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1329.036409] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1329.036409] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1329.036692] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1329.054466] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1329.054647] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1329.054787] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1329.054959] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.055310] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.055501] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.055616] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.055954] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.056155] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17344ffc-b0c3-4c75-9a3d-e161cc0cae8b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.122124] env[69637]: INFO networking_nsxv3.common.synchronization [req-63b3bbfd-f542-47ae-959d-93d06e78f79e req-a35a6845-26af-4838-acef-3716385d2dff tempest-DeleteServersTestJSON-1864882804 tempest-DeleteServersTestJSON-1864882804-project-member] Enqueued Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1329.122610] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7376d44-359d-46ab-85b9-78423d657c47 with Priority: HIGHEST for action security_group_members [ 1329.122911] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7376d44-359d-46ab-85b9-78423d657c47 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.123046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.123108] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.123304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.123451] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.123547] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.123607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.123751] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.123832] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.123922] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7376d44-359d-46ab-85b9-78423d657c47',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.172726] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.173426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.173426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.173426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.173592] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.173732] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.173833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.173896] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.174063] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.174143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.174227] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b336412-26a4-430f-933f-4da7b1cc33cb already deleted. [ 1329.174304] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.563030] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.563030] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.563030] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.563367] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.563367] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.563471] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 17344ffc-b0c3-4c75-9a3d-e161cc0cae8b not found, creating... [ 1329.563728] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.563891] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.564022] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.564248] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.564417] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.564676] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.564835] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.564954] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.565186] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.565323] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.565465] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 17344ffc-b0c3-4c75-9a3d-e161cc0cae8b is going to be created. [ 1329.584353] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.584520] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.584589] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.584778] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.585010] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.585571] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.625416] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.625586] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.625640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.625793] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.657278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.657498] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.657603] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.657667] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.657843] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.657926] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.658028] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 is going to be updated. [ 1329.691112] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.691439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.691439] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.691521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.691647] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.699493] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: IN_PROGRESS for 2s [ 1330.206633] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: SUCCESS [ 1330.206878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.261454] env[69637]: INFO networking_nsxv3.common.synchronization [req-2b7c0f5c-8f4b-4d32-84b3-f3812784781e req-2b99dee2-3920-47e6-959e-376956aa24a7 service nova] Enqueued Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_rules [ 1330.261659] env[69637]: INFO networking_nsxv3.common.synchronization [req-2b7c0f5c-8f4b-4d32-84b3-f3812784781e req-2b99dee2-3920-47e6-959e-376956aa24a7 service nova] Enqueued Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_members [ 1330.261801] env[69637]: INFO networking_nsxv3.common.synchronization [req-2b7c0f5c-8f4b-4d32-84b3-f3812784781e req-2b99dee2-3920-47e6-959e-376956aa24a7 service nova] Enqueued Resource ID: 17344ffc-b0c3-4c75-9a3d-e161cc0cae8b with Priority: HIGHEST for action port [ 1330.262041] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_rules [ 1330.262175] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_members [ 1330.262272] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17344ffc-b0c3-4c75-9a3d-e161cc0cae8b with Priority: HIGHEST for action port [ 1330.262800] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b336412-26a4-430f-933f-4da7b1cc33cb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.262928] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.263022] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.263488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.263630] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.264558] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b336412-26a4-430f-933f-4da7b1cc33cb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.264732] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.264899] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.265118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.265311] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.265454] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.265554] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.265763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.265890] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.266024] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.266853] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.266983] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.267079] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.267274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.267391] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17344ffc-b0c3-4c75-9a3d-e161cc0cae8b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.769131] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b336412-26a4-430f-933f-4da7b1cc33cb taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.769436] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.769485] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.770343] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17344ffc-b0c3-4c75-9a3d-e161cc0cae8b with status ACTIVE [ 1330.770562] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.770669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.770739] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.770939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.771040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.771205] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.771301] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.771363] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.771526] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.771634] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.771771] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.771861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.771918] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.772616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.772616] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.772616] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17344ffc-b0c3-4c75-9a3d-e161cc0cae8b is going to be updated. [ 1330.792016] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.792161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.792161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.792317] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.792440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.792585] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.274573] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.708276] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7376d44-359d-46ab-85b9-78423d657c47 in Status: SUCCESS [ 1331.708491] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7376d44-359d-46ab-85b9-78423d657c47 deletion is rescheduled due to dependency. [ 1331.708610] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7376d44-359d-46ab-85b9-78423d657c47" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.777317] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.777620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.777620] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.777813] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.777902] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.777997] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b336412-26a4-430f-933f-4da7b1cc33cb is going to be created. [ 1331.800495] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.800679] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.800770] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.800963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.801136] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.809789] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b336412-26a4-430f-933f-4da7b1cc33cb in Status: UNINITIALIZED for 2s [ 1333.819737] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b336412-26a4-430f-933f-4da7b1cc33cb in Status: SUCCESS [ 1333.819984] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.820126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.820327] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.820512] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.820646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.820714] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.820869] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.820948] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.821051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.821154] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.323405] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.825715] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b336412-26a4-430f-933f-4da7b1cc33cb: rpc.has_security_group_logging(os_id): False [ 1334.842640] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.842845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.842845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.843105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.843175] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.843387] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.843501] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.843564] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.843686] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.843764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.843848] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b336412-26a4-430f-933f-4da7b1cc33cb is going to be created. [ 1334.959839] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.960064] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.960160] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.960371] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.960589] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.970387] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b336412-26a4-430f-933f-4da7b1cc33cb in Status: IN_PROGRESS for 2s [ 1335.262923] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.263195] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1336.983814] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b336412-26a4-430f-933f-4da7b1cc33cb in Status: SUCCESS [ 1336.984130] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.051722] env[69637]: INFO networking_nsxv3.common.synchronization [None req-27a6dec1-56bf-456d-8bd6-696d19924633 None None] Enqueued Resource ID: 699a728c-3736-4b5b-9c8f-e2e67a7f262c with Priority: HIGHEST for action port [ 1338.052301] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 699a728c-3736-4b5b-9c8f-e2e67a7f262c with Priority: HIGHEST for action port [ 1338.055595] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-699a728c-3736-4b5b-9c8f-e2e67a7f262c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.055595] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-699a728c-3736-4b5b-9c8f-e2e67a7f262c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.055595] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-699a728c-3736-4b5b-9c8f-e2e67a7f262c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.055595] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-699a728c-3736-4b5b-9c8f-e2e67a7f262c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.055595] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('699a728c-3736-4b5b-9c8f-e2e67a7f262c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.558231] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 699a728c-3736-4b5b-9c8f-e2e67a7f262c [ 1338.558488] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.558630] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.558702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.559437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.559437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.559437] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:699a728c-3736-4b5b-9c8f-e2e67a7f262c already deleted. [ 1338.559437] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-699a728c-3736-4b5b-9c8f-e2e67a7f262c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.136328] env[69637]: INFO networking_nsxv3.common.synchronization [None req-c771bb69-d927-49c6-97ba-5a42949e2961 None None] Enqueued Resource ID: f39f38b9-c58d-4650-87bf-72c42cb4dea3 with Priority: HIGHEST for action port [ 1340.136600] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f39f38b9-c58d-4650-87bf-72c42cb4dea3 with Priority: HIGHEST for action port [ 1340.137237] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-f39f38b9-c58d-4650-87bf-72c42cb4dea3 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.137310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f39f38b9-c58d-4650-87bf-72c42cb4dea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.137438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f39f38b9-c58d-4650-87bf-72c42cb4dea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.137612] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f39f38b9-c58d-4650-87bf-72c42cb4dea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.137683] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f39f38b9-c58d-4650-87bf-72c42cb4dea3',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.639744] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f39f38b9-c58d-4650-87bf-72c42cb4dea3 [ 1340.639810] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.639949] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.640033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.640243] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.640335] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.640435] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f39f38b9-c58d-4650-87bf-72c42cb4dea3 already deleted. [ 1340.640569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f39f38b9-c58d-4650-87bf-72c42cb4dea3" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.485103] env[69637]: INFO networking_nsxv3.common.synchronization [req-4f313bbd-7bca-4deb-bab6-a389d394f34c req-f41809e8-9f61-4b35-90b2-14b2efaa4bd2 tempest-InstanceActionsNegativeTestJSON-190888764 tempest-InstanceActionsNegativeTestJSON-190888764-project-member] Enqueued Resource ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 with Priority: HIGHEST for action security_group_members [ 1343.485642] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 with Priority: HIGHEST for action security_group_members [ 1343.485946] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-be3499b6-5e6d-49f0-8831-1b697da4f0c2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.486098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.486179] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.486434] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.486595] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.486697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.486762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.486912] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.486995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.487128] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be3499b6-5e6d-49f0-8831-1b697da4f0c2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.967721] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.967931] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-61" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.968072] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-61" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.968405] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-61" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.968718] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.968940] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.969410] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.970088] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.970259] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.970483] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1343.970605] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1343.970740] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1343.971014] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1343.971157] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1343.971278] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1343.971419] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1343.989304] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.989478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.989552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.989750] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.989917] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.990037] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.990134] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.990200] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.990343] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.990458] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.990550] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 already deleted. [ 1343.990636] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.991613] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1343.991777] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1343.991930] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1343.992108] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-61" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.992423] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-7b500b88-a7af-4dc3-82fc-bebdc92ee32c taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.992603] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-7b500b88-a7af-4dc3-82fc-bebdc92ee32c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.992721] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-7b500b88-a7af-4dc3-82fc-bebdc92ee32c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.992992] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-7b500b88-a7af-4dc3-82fc-bebdc92ee32c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.993187] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b500b88-a7af-4dc3-82fc-bebdc92ee32c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.495412] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.495728] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.495820] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.496115] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.496269] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.496423] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 7b500b88-a7af-4dc3-82fc-bebdc92ee32c not found, creating... [ 1344.496676] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.496834] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.496951] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.497181] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.497375] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.497589] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.497741] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.497861] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.498078] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.498215] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.498353] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 7b500b88-a7af-4dc3-82fc-bebdc92ee32c is going to be created. [ 1344.518055] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.518352] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.518562] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.519179] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.519266] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.519564] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-7b500b88-a7af-4dc3-82fc-bebdc92ee32c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.183140] env[69637]: INFO networking_nsxv3.common.synchronization [req-4f313bbd-7bca-4deb-bab6-a389d394f34c req-322e97e3-e3d4-4654-a1ec-17dfe9709132 service nova] Enqueued Resource ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 with Priority: HIGHEST for action security_group_rules [ 1345.183140] env[69637]: INFO networking_nsxv3.common.synchronization [req-4f313bbd-7bca-4deb-bab6-a389d394f34c req-322e97e3-e3d4-4654-a1ec-17dfe9709132 service nova] Enqueued Resource ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 with Priority: HIGHEST for action security_group_members [ 1345.183140] env[69637]: INFO networking_nsxv3.common.synchronization [req-4f313bbd-7bca-4deb-bab6-a389d394f34c req-322e97e3-e3d4-4654-a1ec-17dfe9709132 service nova] Enqueued Resource ID: 7b500b88-a7af-4dc3-82fc-bebdc92ee32c with Priority: HIGHEST for action port [ 1345.183140] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 with Priority: HIGHEST for action security_group_rules [ 1345.183140] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 with Priority: HIGHEST for action security_group_members [ 1345.183419] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b500b88-a7af-4dc3-82fc-bebdc92ee32c with Priority: HIGHEST for action port [ 1345.183775] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be3499b6-5e6d-49f0-8831-1b697da4f0c2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.183894] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.183966] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.184238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.184321] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be3499b6-5e6d-49f0-8831-1b697da4f0c2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.185152] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-be3499b6-5e6d-49f0-8831-1b697da4f0c2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.185248] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.185313] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.185476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.185683] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.185754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.185754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.185930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.185971] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.186055] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be3499b6-5e6d-49f0-8831-1b697da4f0c2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.187188] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b500b88-a7af-4dc3-82fc-bebdc92ee32c taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.187188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b500b88-a7af-4dc3-82fc-bebdc92ee32c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.187188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b500b88-a7af-4dc3-82fc-bebdc92ee32c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.187188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b500b88-a7af-4dc3-82fc-bebdc92ee32c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.187188] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b500b88-a7af-4dc3-82fc-bebdc92ee32c',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.689139] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be3499b6-5e6d-49f0-8831-1b697da4f0c2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.690504] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-be3499b6-5e6d-49f0-8831-1b697da4f0c2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.690613] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.690817] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b500b88-a7af-4dc3-82fc-bebdc92ee32c with status ACTIVE [ 1345.690980] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.691111] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.691172] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.691361] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.691449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.691612] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.691729] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.691796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.691946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.692038] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.692222] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.692312] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.692365] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.692503] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.692579] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.692662] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b500b88-a7af-4dc3-82fc-bebdc92ee32c is going to be updated. [ 1345.711451] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.711578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.711639] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.711810] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.711938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.712093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b500b88-a7af-4dc3-82fc-bebdc92ee32c" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.194591] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be3499b6-5e6d-49f0-8831-1b697da4f0c2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.698738] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.699135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.699135] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.699263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.699318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.699404] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 is going to be created. [ 1346.722523] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.722677] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.722717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.722862] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.723017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.731656] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 in Status: UNINITIALIZED for 2s [ 1348.741876] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 in Status: SUCCESS [ 1348.742161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.742272] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.742478] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.742666] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.742779] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.742844] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.742988] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.743151] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.743256] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.743348] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be3499b6-5e6d-49f0-8831-1b697da4f0c2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.245282] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-be3499b6-5e6d-49f0-8831-1b697da4f0c2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.245513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.245513] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.245782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.246011] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.246158] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.246245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.246438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.246593] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.246717] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.246887] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-be3499b6-5e6d-49f0-8831-1b697da4f0c2 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.247016] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.247106] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.247292] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.247477] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.247599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.247681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.247859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.247967] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.248087] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.248208] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be3499b6-5e6d-49f0-8831-1b697da4f0c2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.750946] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be3499b6-5e6d-49f0-8831-1b697da4f0c2: rpc.has_security_group_logging(os_id): False [ 1349.768573] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.768786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.768786] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.768975] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.769089] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.769257] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.769358] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.769415] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.769566] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.769646] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.769837] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.769933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.769993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.770156] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.770232] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.770407] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.770499] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.770560] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.770692] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.770805] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.770892] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 is going to be created. [ 1349.824629] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.824853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.824853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.825046] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.825856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.836077] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 in Status: IN_PROGRESS for 2s [ 1350.184123] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.184346] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1351.850203] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 in Status: SUCCESS [ 1351.850570] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.185675] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.186073] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1356.751425] env[69637]: INFO networking_nsxv3.common.synchronization [req-cf40ecf8-7e03-4540-a4d7-370362cdb6ef req-68b86d10-e27d-4b4f-b3ea-d39f97c87f09 tempest-InstanceActionsNegativeTestJSON-190888764 tempest-InstanceActionsNegativeTestJSON-190888764-project-member] Enqueued Resource ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 with Priority: HIGHEST for action security_group_members [ 1356.751960] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 with Priority: HIGHEST for action security_group_members [ 1356.752278] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-be3499b6-5e6d-49f0-8831-1b697da4f0c2 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.752402] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.752471] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.752701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.752882] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.753045] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.753125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.753321] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.753405] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.753517] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be3499b6-5e6d-49f0-8831-1b697da4f0c2',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.255986] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.256232] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.256232] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.256444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.256534] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.256792] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.256943] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.257050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.257266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.257386] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.257518] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 is going to be updated. [ 1357.301757] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.301939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.301939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.302188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.302287] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.310105] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 in Status: IN_PROGRESS for 2s [ 1359.320924] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 in Status: SUCCESS [ 1359.321282] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be3499b6-5e6d-49f0-8831-1b697da4f0c2 deletion is rescheduled due to dependency. [ 1359.321282] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be3499b6-5e6d-49f0-8831-1b697da4f0c2" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.866926] env[69637]: INFO networking_nsxv3.common.synchronization [req-1269a168-03b4-4795-8486-cbd6f23ff89b req-263ead46-1104-4309-a72d-f06c0db296f9 tempest-ServerActionsTestJSON-2076172663 tempest-ServerActionsTestJSON-2076172663-project-member] Enqueued Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 1360.868030] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 1360.868730] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.868730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.868730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.868730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.869052] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.869052] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.869150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.869244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.869327] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.869430] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.371374] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.371544] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.371589] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.371795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.393117] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.393439] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.393569] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.393640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.393897] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.394029] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.394157] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 is going to be updated. [ 1361.418985] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.419202] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.419272] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.419479] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.419648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.426916] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: IN_PROGRESS for 2s [ 1363.437371] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: SUCCESS [ 1363.437649] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 deletion is rescheduled due to dependency. [ 1363.437706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.435123] env[69637]: INFO networking_nsxv3.common.synchronization [None req-01bbab1d-4d94-4d89-8d58-54f972f14704 None None] Enqueued Resource ID: ce150602-7149-4cf8-aa63-a6f2b1a27329 with Priority: HIGHEST for action port [ 1364.435350] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce150602-7149-4cf8-aa63-a6f2b1a27329 with Priority: HIGHEST for action port [ 1364.435905] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce150602-7149-4cf8-aa63-a6f2b1a27329 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.436042] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce150602-7149-4cf8-aa63-a6f2b1a27329" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.436108] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce150602-7149-4cf8-aa63-a6f2b1a27329" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.436367] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce150602-7149-4cf8-aa63-a6f2b1a27329" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.436450] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce150602-7149-4cf8-aa63-a6f2b1a27329',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.939924] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce150602-7149-4cf8-aa63-a6f2b1a27329 [ 1364.939924] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.939924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.939924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.939924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.939924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.939924] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce150602-7149-4cf8-aa63-a6f2b1a27329 already deleted. [ 1364.939924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce150602-7149-4cf8-aa63-a6f2b1a27329" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.521927] env[69637]: INFO networking_nsxv3.common.synchronization [None req-2c7696c1-dbe4-4773-a897-e2cb4c245d36 None None] Enqueued Resource ID: 3be88a6a-7b58-4898-8424-74d34094d5ea with Priority: HIGHEST for action port [ 1366.522240] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be88a6a-7b58-4898-8424-74d34094d5ea with Priority: HIGHEST for action port [ 1366.522731] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-3be88a6a-7b58-4898-8424-74d34094d5ea taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.522856] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3be88a6a-7b58-4898-8424-74d34094d5ea" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.522923] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3be88a6a-7b58-4898-8424-74d34094d5ea" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.523194] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3be88a6a-7b58-4898-8424-74d34094d5ea" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.523320] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3be88a6a-7b58-4898-8424-74d34094d5ea',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.027423] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3be88a6a-7b58-4898-8424-74d34094d5ea [ 1367.027645] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.027779] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.027851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.028096] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.028186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.028283] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3be88a6a-7b58-4898-8424-74d34094d5ea already deleted. [ 1367.028364] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3be88a6a-7b58-4898-8424-74d34094d5ea" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.190496] env[69637]: INFO networking_nsxv3.common.synchronization [req-4d508cb8-65b4-44a1-8022-91f5a1c44700 req-05c894fc-9c56-4d25-966d-082bdb0f0b1f tempest-ServerActionsTestJSON-2076172663 tempest-ServerActionsTestJSON-2076172663-project-member] Enqueued Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 1368.191061] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 1368.191382] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.191494] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.191559] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.191764] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.191906] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.192076] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.192163] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.192375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.192414] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.192486] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.464906] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-970 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.464906] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.464906] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.465192] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.465370] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.465531] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.465650] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.465872] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.466071] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.466297] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1368.466419] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1368.466530] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1368.466648] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1368.466761] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1368.466869] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1368.467009] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1368.492939] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1368.493114] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1368.493260] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1368.493424] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-970" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.493701] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-c3b8f3f4-e7ff-41c5-ac33-dfb053e43995 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.493863] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-c3b8f3f4-e7ff-41c5-ac33-dfb053e43995" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.493987] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-c3b8f3f4-e7ff-41c5-ac33-dfb053e43995" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.494291] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-c3b8f3f4-e7ff-41c5-ac33-dfb053e43995" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.494431] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3b8f3f4-e7ff-41c5-ac33-dfb053e43995',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.695465] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.695671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.695751] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.695966] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.696075] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.696276] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.696374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.696438] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.696597] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.696674] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.696758] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 is going to be updated. [ 1368.722900] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.723093] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.723143] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.723293] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.723429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.734420] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: IN_PROGRESS for 2s [ 1368.997082] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.997285] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.997413] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.998038] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.998038] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.998038] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port c3b8f3f4-e7ff-41c5-ac33-dfb053e43995 not found, creating... [ 1368.998271] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.998432] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.998554] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.998771] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.998922] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.999229] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.999389] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.999510] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.999718] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.999857] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.000007] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: c3b8f3f4-e7ff-41c5-ac33-dfb053e43995 is going to be created. [ 1369.022037] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.022037] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.022037] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.022037] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.022037] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.022037] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-c3b8f3f4-e7ff-41c5-ac33-dfb053e43995" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.696861] env[69637]: INFO networking_nsxv3.common.synchronization [req-4d508cb8-65b4-44a1-8022-91f5a1c44700 req-9b5b40f0-7ca3-4025-95bf-5d2564a68b78 service nova] Enqueued Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_rules [ 1369.697140] env[69637]: INFO networking_nsxv3.common.synchronization [req-4d508cb8-65b4-44a1-8022-91f5a1c44700 req-9b5b40f0-7ca3-4025-95bf-5d2564a68b78 service nova] Enqueued Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 1369.697211] env[69637]: INFO networking_nsxv3.common.synchronization [req-4d508cb8-65b4-44a1-8022-91f5a1c44700 req-9b5b40f0-7ca3-4025-95bf-5d2564a68b78 service nova] Enqueued Resource ID: c3b8f3f4-e7ff-41c5-ac33-dfb053e43995 with Priority: HIGHEST for action port [ 1369.697429] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_rules [ 1369.697555] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 1369.697653] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b8f3f4-e7ff-41c5-ac33-dfb053e43995 with Priority: HIGHEST for action port [ 1369.698207] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.698338] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.698406] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.698599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.698679] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.699674] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.699758] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.699891] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3b8f3f4-e7ff-41c5-ac33-dfb053e43995 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.699979] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3b8f3f4-e7ff-41c5-ac33-dfb053e43995" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.700051] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3b8f3f4-e7ff-41c5-ac33-dfb053e43995" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.700213] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3b8f3f4-e7ff-41c5-ac33-dfb053e43995" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.700285] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3b8f3f4-e7ff-41c5-ac33-dfb053e43995',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.205034] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.205034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.205034] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3b8f3f4-e7ff-41c5-ac33-dfb053e43995 with status ACTIVE [ 1370.205034] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.205034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.205034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.205034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.205034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.205034] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.205034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.205034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.205034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.205034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.205034] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.206295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.206295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.206295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.206295] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.206295] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3b8f3f4-e7ff-41c5-ac33-dfb053e43995 is going to be updated. [ 1370.227591] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.227762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.227808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.227994] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.228148] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.228310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3b8f3f4-e7ff-41c5-ac33-dfb053e43995" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.352036] env[69637]: INFO networking_nsxv3.common.synchronization [req-bd77ec41-5674-4034-ae28-5b4d9c6ffc7a req-0b6a2b6c-971c-49dc-a911-cac75b2bd82f tempest-ServerRescueTestJSONUnderV235-1886825060 tempest-ServerRescueTestJSONUnderV235-1886825060-project-member] Enqueued Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_members [ 1370.352945] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_members [ 1370.352945] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18f8e92-c92a-4a8f-a651-74efa589d955 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.353105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.353164] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.356026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.356026] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.356026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.356026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.356026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.356026] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.356026] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.634581] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.634785] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-769" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.634914] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-769" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.635284] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-769" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.635555] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.635718] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.635838] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.636086] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.636324] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.636584] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1370.636720] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1370.636837] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1370.636948] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1370.637076] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1370.637189] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1370.637334] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1370.657647] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1370.657787] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1370.657894] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1370.658080] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-769" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.658439] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.658608] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.658732] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.659043] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.659224] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.761398] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: SUCCESS [ 1370.761762] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 deletion is rescheduled due to dependency. [ 1370.761812] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.762865] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.762865] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.762865] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.762865] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.762865] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.762865] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.762865] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.763316] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.856027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.856267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.856267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.856482] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.856565] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.856777] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.856871] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.856937] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.857090] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.857161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.857251] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18f8e92-c92a-4a8f-a651-74efa589d955 already deleted. [ 1370.857318] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.161870] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.162167] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.162334] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.162632] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.162785] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.162948] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Segment Port 5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 not found, creating... [ 1371.163234] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.163437] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.163562] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.163787] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.163927] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.164223] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.164383] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.164504] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.164711] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.164850] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.164991] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 is going to be created. [ 1371.183147] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.183422] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.183601] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.183890] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.184135] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.184371] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.266086] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.768744] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.876186] env[69637]: INFO networking_nsxv3.common.synchronization [req-bd77ec41-5674-4034-ae28-5b4d9c6ffc7a req-4733c274-1166-42a9-a4d4-4459cbd979d3 service nova] Enqueued Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_rules [ 1371.876374] env[69637]: INFO networking_nsxv3.common.synchronization [req-bd77ec41-5674-4034-ae28-5b4d9c6ffc7a req-4733c274-1166-42a9-a4d4-4459cbd979d3 service nova] Enqueued Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_members [ 1371.876517] env[69637]: INFO networking_nsxv3.common.synchronization [req-bd77ec41-5674-4034-ae28-5b4d9c6ffc7a req-4733c274-1166-42a9-a4d4-4459cbd979d3 service nova] Enqueued Resource ID: 5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 with Priority: HIGHEST for action port [ 1371.876980] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_rules [ 1371.877177] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_members [ 1371.877214] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 with Priority: HIGHEST for action port [ 1371.877477] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a18f8e92-c92a-4a8f-a651-74efa589d955 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.877598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.877688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.877905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.877988] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.878759] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18f8e92-c92a-4a8f-a651-74efa589d955 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.878873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.878940] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.879126] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.879268] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.879362] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.879425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.879562] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.879663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.879750] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.880425] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.880533] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.880595] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.880744] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.880813] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.272309] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.272572] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.272663] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.272916] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.273086] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.273258] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 is going to be updated. [ 1372.306549] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.306758] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.306884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.308033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.308033] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.316172] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: IN_PROGRESS for 2s [ 1372.382777] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18f8e92-c92a-4a8f-a651-74efa589d955 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.382953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.383136] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.385793] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 with status ACTIVE [ 1372.386010] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.386137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.386203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.386410] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.386498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.386689] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.386790] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.386851] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.387025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.387115] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.387315] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.387449] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.387497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.387608] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.387683] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.387767] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 is going to be updated. [ 1372.407638] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.407853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.407853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.408067] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.408220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.408380] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.885708] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.388573] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.389193] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.389319] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.389589] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.389688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.389791] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18f8e92-c92a-4a8f-a651-74efa589d955 is going to be created. [ 1373.420423] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.420650] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.420650] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.420867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.421092] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.429663] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: UNINITIALIZED for 2s [ 1374.325247] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: SUCCESS [ 1374.325576] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.325640] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.325860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.326065] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.326184] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.326252] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.326426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.326510] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.326596] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.326685] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.828692] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.331433] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6b27dfc-30ce-43c0-922c-60d619d56e60: rpc.has_security_group_logging(os_id): False [ 1375.348243] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.348473] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.348473] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.348648] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.348740] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.349651] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.349772] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.349850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.350024] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.350114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.350206] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 is going to be updated. [ 1375.408527] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.408762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.408762] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.409011] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.409219] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.428057] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: IN_PROGRESS for 2s [ 1375.443513] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: SUCCESS [ 1375.443726] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.443901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.444144] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.444332] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.444453] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.444521] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.444664] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.444741] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.444828] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.444923] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.947230] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18f8e92-c92a-4a8f-a651-74efa589d955 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.947409] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.947467] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.949220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.949439] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.949563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.949633] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.949806] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.949894] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.949985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.950146] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18f8e92-c92a-4a8f-a651-74efa589d955 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.950245] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.950303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.950444] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.950578] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.950668] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.950730] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.950866] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.950942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.951037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.951148] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.454146] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a18f8e92-c92a-4a8f-a651-74efa589d955: rpc.has_security_group_logging(os_id): False [ 1376.473263] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.473538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.473607] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.473802] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.473884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.474124] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.474222] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.474283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.474440] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.474519] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.474727] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.474823] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.474888] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.475040] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.475224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.475317] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.475407] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.475463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.475625] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.475702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.475789] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a18f8e92-c92a-4a8f-a651-74efa589d955 is going to be created. [ 1376.534075] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.534280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.534280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.534489] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.534670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.547563] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: IN_PROGRESS for 2s [ 1376.877840] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1376.877976] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1377.441527] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: SUCCESS [ 1377.441743] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.565619] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: SUCCESS [ 1378.565619] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.879089] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.879505] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.879908] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.880196] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1388.924557] env[69637]: INFO networking_nsxv3.common.synchronization [req-f6b9591e-cca2-4af0-bc1b-a4808f6f7e4c req-b3eaebd3-4470-4310-85b6-e1fbe2881ea7 tempest-ServerRescueTestJSONUnderV235-1886825060 tempest-ServerRescueTestJSONUnderV235-1886825060-project-member] Enqueued Resource ID: e438a3d7-d0bf-47ea-a148-9be624646506 with Priority: HIGHEST for action security_group_members [ 1388.924854] env[69637]: INFO networking_nsxv3.common.synchronization [req-f6b9591e-cca2-4af0-bc1b-a4808f6f7e4c req-b3eaebd3-4470-4310-85b6-e1fbe2881ea7 tempest-ServerRescueTestJSONUnderV235-1886825060 tempest-ServerRescueTestJSONUnderV235-1886825060-project-member] Enqueued Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_members [ 1388.925309] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e438a3d7-d0bf-47ea-a148-9be624646506 with Priority: HIGHEST for action security_group_members [ 1388.925448] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_members [ 1388.925735] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-e438a3d7-d0bf-47ea-a148-9be624646506 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.925868] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.925930] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.926203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.926384] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.926495] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.926554] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.926702] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.926783] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.926876] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e438a3d7-d0bf-47ea-a148-9be624646506',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.927750] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18f8e92-c92a-4a8f-a651-74efa589d955 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.927975] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.927975] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.928103] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.928377] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.928377] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.928525] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.928579] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.928630] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.928718] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.968288] env[69637]: INFO networking_nsxv3.common.synchronization [req-f6b9591e-cca2-4af0-bc1b-a4808f6f7e4c req-b3eaebd3-4470-4310-85b6-e1fbe2881ea7 tempest-ServerRescueTestJSONUnderV235-1886825060 tempest-ServerRescueTestJSONUnderV235-1886825060-project-member] Enqueued Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_rules [ 1388.968470] env[69637]: INFO networking_nsxv3.common.synchronization [req-f6b9591e-cca2-4af0-bc1b-a4808f6f7e4c req-b3eaebd3-4470-4310-85b6-e1fbe2881ea7 tempest-ServerRescueTestJSONUnderV235-1886825060 tempest-ServerRescueTestJSONUnderV235-1886825060-project-member] Enqueued Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_members [ 1388.968609] env[69637]: INFO networking_nsxv3.common.synchronization [req-f6b9591e-cca2-4af0-bc1b-a4808f6f7e4c req-b3eaebd3-4470-4310-85b6-e1fbe2881ea7 tempest-ServerRescueTestJSONUnderV235-1886825060 tempest-ServerRescueTestJSONUnderV235-1886825060-project-member] Enqueued Resource ID: e438a3d7-d0bf-47ea-a148-9be624646506 with Priority: HIGHEST for action security_group_rules [ 1388.968742] env[69637]: INFO networking_nsxv3.common.synchronization [req-f6b9591e-cca2-4af0-bc1b-a4808f6f7e4c req-b3eaebd3-4470-4310-85b6-e1fbe2881ea7 tempest-ServerRescueTestJSONUnderV235-1886825060 tempest-ServerRescueTestJSONUnderV235-1886825060-project-member] Enqueued Resource ID: e438a3d7-d0bf-47ea-a148-9be624646506 with Priority: HIGHEST for action security_group_members [ 1388.968929] env[69637]: INFO networking_nsxv3.common.synchronization [req-f6b9591e-cca2-4af0-bc1b-a4808f6f7e4c req-b3eaebd3-4470-4310-85b6-e1fbe2881ea7 tempest-ServerRescueTestJSONUnderV235-1886825060 tempest-ServerRescueTestJSONUnderV235-1886825060-project-member] Enqueued Resource ID: 5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 with Priority: HIGHEST for action port [ 1388.969405] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_rules [ 1388.969543] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e438a3d7-d0bf-47ea-a148-9be624646506 with Priority: HIGHEST for action security_group_rules [ 1388.969728] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 with Priority: HIGHEST for action port [ 1388.969801] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_members [ 1388.969847] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e438a3d7-d0bf-47ea-a148-9be624646506 with Priority: HIGHEST for action security_group_members [ 1388.970204] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a18f8e92-c92a-4a8f-a651-74efa589d955 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.970272] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.970326] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.970508] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.970568] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.971431] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e438a3d7-d0bf-47ea-a148-9be624646506 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.971545] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.971612] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.971826] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.971904] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e438a3d7-d0bf-47ea-a148-9be624646506',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.972626] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.972736] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.972803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.972960] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.973047] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.973732] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18f8e92-c92a-4a8f-a651-74efa589d955 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.973837] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.974522] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-e438a3d7-d0bf-47ea-a148-9be624646506 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.974623] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.284490] env[69637]: INFO networking_nsxv3.common.synchronization [req-249346b3-609b-496a-9d46-d9291a8aedd4 req-ff7f16de-f6bc-4cac-b437-3e8d47700060 tempest-ServerRescueTestJSONUnderV235-1886825060 tempest-ServerRescueTestJSONUnderV235-1886825060-project-member] Enqueued Resource ID: e438a3d7-d0bf-47ea-a148-9be624646506 with Priority: HIGHEST for action security_group_members [ 1389.284714] env[69637]: INFO networking_nsxv3.common.synchronization [req-249346b3-609b-496a-9d46-d9291a8aedd4 req-ff7f16de-f6bc-4cac-b437-3e8d47700060 tempest-ServerRescueTestJSONUnderV235-1886825060 tempest-ServerRescueTestJSONUnderV235-1886825060-project-member] Enqueued Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_members [ 1389.285276] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e438a3d7-d0bf-47ea-a148-9be624646506 with Priority: HIGHEST for action security_group_members [ 1389.285435] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_members [ 1389.285749] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-e438a3d7-d0bf-47ea-a148-9be624646506 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.285867] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.286284] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18f8e92-c92a-4a8f-a651-74efa589d955 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.286394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.328413] env[69637]: INFO networking_nsxv3.common.synchronization [req-249346b3-609b-496a-9d46-d9291a8aedd4 req-ff7f16de-f6bc-4cac-b437-3e8d47700060 tempest-ServerRescueTestJSONUnderV235-1886825060 tempest-ServerRescueTestJSONUnderV235-1886825060-project-member] Enqueued Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_rules [ 1389.328595] env[69637]: INFO networking_nsxv3.common.synchronization [req-249346b3-609b-496a-9d46-d9291a8aedd4 req-ff7f16de-f6bc-4cac-b437-3e8d47700060 tempest-ServerRescueTestJSONUnderV235-1886825060 tempest-ServerRescueTestJSONUnderV235-1886825060-project-member] Enqueued Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_members [ 1389.328739] env[69637]: INFO networking_nsxv3.common.synchronization [req-249346b3-609b-496a-9d46-d9291a8aedd4 req-ff7f16de-f6bc-4cac-b437-3e8d47700060 tempest-ServerRescueTestJSONUnderV235-1886825060 tempest-ServerRescueTestJSONUnderV235-1886825060-project-member] Enqueued Resource ID: 5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 with Priority: HIGHEST for action port [ 1389.329261] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_rules [ 1389.329390] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_members [ 1389.329487] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 with Priority: HIGHEST for action port [ 1389.329757] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a18f8e92-c92a-4a8f-a651-74efa589d955 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.329910] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.330046] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18f8e92-c92a-4a8f-a651-74efa589d955 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.330129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.330307] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.330376] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.430900] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e438a3d7-d0bf-47ea-a148-9be624646506',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.431860] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.476755] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18f8e92-c92a-4a8f-a651-74efa589d955 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.476755] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.476755] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-e438a3d7-d0bf-47ea-a148-9be624646506 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.476755] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.476755] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 with status ACTIVE [ 1389.477166] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.477166] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.477166] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.477299] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.477372] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.477543] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.477657] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.477720] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.477877] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.477970] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.478153] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.478260] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.478326] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.478464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.478538] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.478690] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 is going to be updated. [ 1389.501068] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.501259] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.501311] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.501498] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.501638] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.501815] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.501963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.502463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.502463] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.933388] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e438a3d7-d0bf-47ea-a148-9be624646506',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.934525] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.004431] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 with status ACTIVE [ 1390.004691] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.004859] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.004927] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.005183] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.005286] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.005697] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.005697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.005697] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.005894] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.005933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.006169] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.006280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.006342] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.006509] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.006595] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.006680] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348 is going to be updated. [ 1390.028987] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.029218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.029268] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.029481] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.029622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.029817] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b6d9228-e2eb-4a05-a1dc-9ed9df5b2348" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.436189] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.436367] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.436425] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.436617] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.436703] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.436924] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e438a3d7-d0bf-47ea-a148-9be624646506 is going to be created. [ 1390.438032] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.438157] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.438218] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.438374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.438456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.438546] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18f8e92-c92a-4a8f-a651-74efa589d955 is going to be updated. [ 1390.465938] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.466107] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.466220] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.466463] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.466627] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.476823] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e438a3d7-d0bf-47ea-a148-9be624646506 in Status: UNINITIALIZED for 2s [ 1390.479040] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.479186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.479291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.479487] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.479691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.488057] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: IN_PROGRESS for 2s [ 1390.527798] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-680 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.528018] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.528153] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.528427] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.528696] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.528857] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.529076] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.529237] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.529408] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.529594] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1390.529711] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1390.529826] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1390.529935] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1390.530149] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1390.530225] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1390.530327] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1390.549276] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1390.549442] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1390.549576] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1390.549757] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-680" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.550078] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-40286812-d681-4fd0-b99e-da8b86ae7810 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.550260] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.550382] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.550645] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.550785] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40286812-d681-4fd0-b99e-da8b86ae7810',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.053583] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.053954] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.053954] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.054213] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.054367] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.054659] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.054820] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.054941] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.055179] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.055324] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.055610] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.055777] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.055892] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.056119] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.056259] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.056404] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 40286812-d681-4fd0-b99e-da8b86ae7810 is going to be updated. [ 1391.077116] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.077343] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.077453] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.077709] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.077937] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.078136] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.907021] env[69637]: INFO networking_nsxv3.common.synchronization [req-9f844b31-d3ca-405c-95fc-9a5c53b8d217 req-bf4708b4-f123-4c23-b04e-6038f57a3fcb service nova] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_rules [ 1391.907021] env[69637]: INFO networking_nsxv3.common.synchronization [req-9f844b31-d3ca-405c-95fc-9a5c53b8d217 req-bf4708b4-f123-4c23-b04e-6038f57a3fcb service nova] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1391.907021] env[69637]: INFO networking_nsxv3.common.synchronization [req-9f844b31-d3ca-405c-95fc-9a5c53b8d217 req-bf4708b4-f123-4c23-b04e-6038f57a3fcb service nova] Enqueued Resource ID: 40286812-d681-4fd0-b99e-da8b86ae7810 with Priority: HIGHEST for action port [ 1391.907021] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_rules [ 1391.907021] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1391.907021] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40286812-d681-4fd0-b99e-da8b86ae7810 with Priority: HIGHEST for action port [ 1391.907021] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.907021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.907021] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.907892] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.908089] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.909414] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.909661] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.909911] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.910325] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.910556] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.912018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.912018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.912018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.912018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.912018] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.912018] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-40286812-d681-4fd0-b99e-da8b86ae7810 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.912476] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.912642] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.912873] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.913064] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40286812-d681-4fd0-b99e-da8b86ae7810',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.414993] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.416014] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.416152] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.416464] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40286812-d681-4fd0-b99e-da8b86ae7810 with status ACTIVE [ 1392.416626] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.416731] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.416795] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.416994] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.417090] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.417251] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.417345] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.417411] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.417547] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.417622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.417804] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.417900] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.417953] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.418084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.418155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.418236] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40286812-d681-4fd0-b99e-da8b86ae7810 is going to be updated. [ 1392.441563] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.441698] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.441763] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.441947] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.442084] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.442239] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40286812-d681-4fd0-b99e-da8b86ae7810" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.489725] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e438a3d7-d0bf-47ea-a148-9be624646506 in Status: SUCCESS [ 1392.489926] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.490375] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.490599] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.490769] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.490878] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.490941] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.491101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.491181] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.491297] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e438a3d7-d0bf-47ea-a148-9be624646506',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.499988] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: SUCCESS [ 1392.500184] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.500553] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.500726] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.500882] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.500987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.501062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.501205] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.501320] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.501398] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.918047] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.993577] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.993738] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.993796] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.994014] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.994106] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.994291] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.994389] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.994488] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.994595] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.994671] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.994754] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e438a3d7-d0bf-47ea-a148-9be624646506 is going to be deleted. [ 1393.003192] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.027900] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.028066] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.028124] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.028280] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.028368] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.028462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.028835] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.029009] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.029178] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.029312] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.029418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.029631] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.029754] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.029892] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e438a3d7-d0bf-47ea-a148-9be624646506',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.419583] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.419981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.419981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.419981] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.420153] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.420194] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 is going to be updated. [ 1393.447509] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.447691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.447691] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.447884] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.448036] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.461678] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: IN_PROGRESS for 2s [ 1393.505182] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.532669] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.532669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.532669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.532669] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.532927] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.532927] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.533020] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.533217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.533217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.533329] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.533369] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e438a3d7-d0bf-47ea-a148-9be624646506 already deleted. [ 1393.533435] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.533575] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.533716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.533854] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.533938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.533995] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.534137] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.534203] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.534287] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e438a3d7-d0bf-47ea-a148-9be624646506',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.007572] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.007773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.007773] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.007987] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.008101] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.008185] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18f8e92-c92a-4a8f-a651-74efa589d955 is going to be updated. [ 1394.034994] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.035165] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.035217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.035424] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.035581] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.036712] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.036840] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.036885] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.037054] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.037133] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.037303] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.037398] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.037460] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.037598] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.037672] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.037752] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e438a3d7-d0bf-47ea-a148-9be624646506 already deleted. [ 1394.037831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.037920] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e438a3d7-d0bf-47ea-a148-9be624646506',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.046457] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: IN_PROGRESS for 2s [ 1394.540869] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e438a3d7-d0bf-47ea-a148-9be624646506',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.745950] env[69637]: INFO networking_nsxv3.common.synchronization [req-e7e1da8d-236b-4fb6-b7f5-2d4f060fa8bd req-c5dc73b0-d825-4f94-9c95-a6d9682e9087 tempest-ServerRescueTestJSONUnderV235-1886825060 tempest-ServerRescueTestJSONUnderV235-1886825060-project-member] Enqueued Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_members [ 1394.746460] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18f8e92-c92a-4a8f-a651-74efa589d955 with Priority: HIGHEST for action security_group_members [ 1394.746752] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18f8e92-c92a-4a8f-a651-74efa589d955 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.746861] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.043969] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e438a3d7-d0bf-47ea-a148-9be624646506: rpc.has_security_group_logging(os_id): False [ 1395.064159] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.064394] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.064546] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.064801] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.064939] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.065185] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.065355] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.065462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.065781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.065927] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.066128] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e438a3d7-d0bf-47ea-a148-9be624646506 is going to be created. [ 1395.088744] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e438a3d7-d0bf-47ea-a148-9be624646506], does not exist path=[/infra/domains/default/groups/e438a3d7-d0bf-47ea-a148-9be624646506]."\n}' [ 1395.088909] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e438a3d7-d0bf-47ea-a148-9be624646506 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e438a3d7-d0bf-47ea-a148-9be624646506 [ 1395.088981] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1395.125308] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.125541] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.125541] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.125704] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.126556] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.126821] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.126945] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.127032] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.127211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.127310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.127501] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.127619] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.127688] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.127860] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.127942] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.128055] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e438a3d7-d0bf-47ea-a148-9be624646506 is going to be created. [ 1395.143539] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e438a3d7-d0bf-47ea-a148-9be624646506], does not exist path=[/infra/domains/default/groups/e438a3d7-d0bf-47ea-a148-9be624646506]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e438a3d7-d0bf-47ea-a148-9be624646506 [ 1395.143711] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e438a3d7-d0bf-47ea-a148-9be624646506" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.143917] env[69637]: Traceback (most recent call last): [ 1395.143968] env[69637]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1395.143968] env[69637]: return func(*args, **kwargs) [ 1395.143968] env[69637]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1395.143968] env[69637]: res.raise_for_status() [ 1395.143968] env[69637]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1395.143968] env[69637]: raise HTTPError(http_error_msg, response=self) [ 1395.143968] env[69637]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e438a3d7-d0bf-47ea-a148-9be624646506 [ 1395.143968] env[69637]: During handling of the above exception, another exception occurred: [ 1395.143968] env[69637]: Traceback (most recent call last): [ 1395.143968] env[69637]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1395.143968] env[69637]: listener.cb(fileno) [ 1395.143968] env[69637]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1395.143968] env[69637]: result = function(*args, **kwargs) [ 1395.143968] env[69637]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1395.143968] env[69637]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1395.143968] env[69637]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1395.143968] env[69637]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1395.143968] env[69637]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1395.143968] env[69637]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1395.143968] env[69637]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1395.143968] env[69637]: res.raise_for_status() [ 1395.143968] env[69637]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1395.143968] env[69637]: raise HTTPError(http_error_msg, response=self) [ 1395.144922] env[69637]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e438a3d7-d0bf-47ea-a148-9be624646506 [ 1395.144922] env[69637]: Removing descriptor: 73 [ 1395.473328] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: SUCCESS [ 1395.473559] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.473723] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.473931] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.474129] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.474246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.474310] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.474455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.474536] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.474619] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.474712] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.977403] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.057453] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: SUCCESS [ 1396.057701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.057919] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.058209] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.058430] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.058587] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.058681] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.058895] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.058993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.059126] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.479327] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abc9ca0b-4c93-42fd-9003-750112e8dab1: rpc.has_security_group_logging(os_id): False [ 1396.497012] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.497210] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.497291] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.497469] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.517349] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.517698] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.517853] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.517924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.518125] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.518238] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.518347] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 is going to be updated. [ 1396.561468] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.561701] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.561824] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.562118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.585027] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.585244] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.586746] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.586971] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.587094] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.587161] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.587353] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.587435] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.587525] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18f8e92-c92a-4a8f-a651-74efa589d955 is going to be updated. [ 1396.588431] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.588612] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.588751] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.604543] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: IN_PROGRESS for 2s [ 1396.626810] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.626979] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.627049] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.627196] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.627331] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.656907] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: IN_PROGRESS for 2s [ 1398.740137] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: SUCCESS [ 1398.740535] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.741749] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: SUCCESS [ 1398.742121] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18f8e92-c92a-4a8f-a651-74efa589d955 deletion is rescheduled due to dependency. [ 1398.742121] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.742228] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.742432] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.742629] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.742741] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.742808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.742975] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.743068] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.743167] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.245846] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.246037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.246037] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.246267] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.246374] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.246570] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.246699] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.246758] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.246870] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.247017] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.247112] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18f8e92-c92a-4a8f-a651-74efa589d955 is going to be updated. [ 1399.276064] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.276188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.276266] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.276419] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.276552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.286755] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: IN_PROGRESS for 2s [ 1399.747777] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1399.748027] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1401.297836] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: SUCCESS [ 1401.298274] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18f8e92-c92a-4a8f-a651-74efa589d955 deletion is rescheduled due to dependency. [ 1401.298274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.298274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.298408] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.298555] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.298670] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.298735] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.298887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.298993] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.299062] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.299413] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.300271] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.300443] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.300604] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.300722] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.300782] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.300924] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.301013] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.301104] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.802751] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.804329] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.804481] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.804481] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.804687] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.804779] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.805030] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.805159] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.805226] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.805383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.805462] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.805550] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18f8e92-c92a-4a8f-a651-74efa589d955 is going to be updated. [ 1401.838809] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.839050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.839050] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.839283] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.839451] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.849506] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: IN_PROGRESS for 2s [ 1402.308207] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a18f8e92-c92a-4a8f-a651-74efa589d955: rpc.has_security_group_logging(os_id): False [ 1402.327866] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.328083] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.328140] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.328340] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.328429] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.328628] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.328724] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.328787] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.328933] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.329018] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.329104] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a18f8e92-c92a-4a8f-a651-74efa589d955 is going to be updated. [ 1402.394384] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.394552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.394612] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.394831] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.394963] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.408710] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: IN_PROGRESS for 2s [ 1403.865784] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: SUCCESS [ 1403.866192] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18f8e92-c92a-4a8f-a651-74efa589d955 deletion is rescheduled due to dependency. [ 1403.866192] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.422934] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a18f8e92-c92a-4a8f-a651-74efa589d955 in Status: SUCCESS [ 1404.423215] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.423339] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.423554] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.423646] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a18f8e92-c92a-4a8f-a651-74efa589d955',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.748356] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1404.748748] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1404.945190] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.945190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.945190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.945190] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.958566] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.958680] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a18f8e92-c92a-4a8f-a651-74efa589d955 is going to be deleted. [ 1404.996245] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.996392] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.996464] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.996675] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.996768] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.996871] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a18f8e92-c92a-4a8f-a651-74efa589d955" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.017776] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.017968] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.018107] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.018357] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.018614] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.018775] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.018895] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.019123] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.019270] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.019515] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1405.019658] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] NeedRegenerationException {{(pid=69637) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1405.019776] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] no value, waiting for create lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1405.019887] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] value creation lock acquired {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1405.019999] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] No value present for key: 'zone-id' {{(pid=69637) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1405.020121] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Calling creation function for not-yet-present value {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1405.020253] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1405.039463] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1405.039686] env[69637]: DEBUG dogpile.cache.region [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69637) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1405.039871] env[69637]: DEBUG dogpile.lock [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Released creation lock {{(pid=69637) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1405.040079] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "network-238" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.040362] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b taken with stack trace [, , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.040528] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.040649] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.040912] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.041101] env[69637]: DEBUG networking_nsxv3.api.rpc [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17344ffc-b0c3-4c75-9a3d-e161cc0cae8b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.543900] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.544116] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.544245] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.544514] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.544671] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.544950] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.545122] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.545244] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.545467] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.545610] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.545976] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.546163] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.546287] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.546499] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.546637] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.546775] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Resource: SegmentPort with ID: 17344ffc-b0c3-4c75-9a3d-e161cc0cae8b is going to be updated. [ 1405.568206] env[69637]: DEBUG networking_nsxv3.common.locking [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.568367] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.568492] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.568712] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.568895] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.569119] env[69637]: DEBUG oslo_concurrency.lockutils [None req-1a3abd72-b581-43e9-8a74-d3bd3001f473 None None] Releasing lock "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.223382] env[69637]: INFO networking_nsxv3.common.synchronization [req-4531e005-3f63-4bc7-8068-c9195bbc4b5a req-995b4b77-0932-4823-8e31-6f221ab8e673 service nova] Enqueued Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_rules [ 1406.223626] env[69637]: INFO networking_nsxv3.common.synchronization [req-4531e005-3f63-4bc7-8068-c9195bbc4b5a req-995b4b77-0932-4823-8e31-6f221ab8e673 service nova] Enqueued Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_members [ 1406.223731] env[69637]: INFO networking_nsxv3.common.synchronization [req-4531e005-3f63-4bc7-8068-c9195bbc4b5a req-995b4b77-0932-4823-8e31-6f221ab8e673 service nova] Enqueued Resource ID: 17344ffc-b0c3-4c75-9a3d-e161cc0cae8b with Priority: HIGHEST for action port [ 1406.223914] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_rules [ 1406.224064] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_members [ 1406.224165] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17344ffc-b0c3-4c75-9a3d-e161cc0cae8b with Priority: HIGHEST for action port [ 1406.224735] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b336412-26a4-430f-933f-4da7b1cc33cb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.224808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.224866] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.225128] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.225217] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.226387] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b336412-26a4-430f-933f-4da7b1cc33cb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.226632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.226632] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.226732] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.226897] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.226992] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.227120] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.227155] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.227227] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.227393] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.227979] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.228118] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.228184] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.228302] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.228372] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17344ffc-b0c3-4c75-9a3d-e161cc0cae8b',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.733316] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b336412-26a4-430f-933f-4da7b1cc33cb taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.733529] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.733627] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.734622] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17344ffc-b0c3-4c75-9a3d-e161cc0cae8b with status ACTIVE [ 1406.734753] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.734845] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.734905] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.735098] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.735188] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.735362] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.735455] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.735524] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.735665] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.735742] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.735921] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.736208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.736208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.736208] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.736388] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.736388] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17344ffc-b0c3-4c75-9a3d-e161cc0cae8b is going to be updated. [ 1406.756253] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.756417] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.756461] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.756609] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.756741] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.756887] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17344ffc-b0c3-4c75-9a3d-e161cc0cae8b" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.230370] env[69637]: INFO networking_nsxv3.common.synchronization [req-16fa4d74-6c41-4a9d-8bb1-3cf030193203 req-a7d04c67-f923-4829-9dd5-bb8f7c47879e tempest-ServerActionsTestOtherB-2018875684 tempest-ServerActionsTestOtherB-2018875684-project-member] Enqueued Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1407.230864] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 with Priority: HIGHEST for action security_group_members [ 1407.231178] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-abc9ca0b-4c93-42fd-9003-750112e8dab1 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.231303] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.231383] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.231578] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.231733] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.231833] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.231893] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.232048] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.232139] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.232228] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abc9ca0b-4c93-42fd-9003-750112e8dab1',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.237631] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.733936] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.734201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.734201] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.734456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.734571] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.734774] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.734875] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.734938] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.735106] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.735246] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.735292] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 is going to be updated. [ 1407.741070] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.741180] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.741265] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.741403] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.741518] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.741597] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b336412-26a4-430f-933f-4da7b1cc33cb is going to be updated. [ 1407.764350] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.764563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.764563] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.764854] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.765105] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.767303] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.767456] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.767552] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.767777] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.767952] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.780066] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b336412-26a4-430f-933f-4da7b1cc33cb in Status: IN_PROGRESS for 2s [ 1407.780800] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: IN_PROGRESS for 2s [ 1409.791350] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b336412-26a4-430f-933f-4da7b1cc33cb in Status: SUCCESS [ 1409.791803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.791803] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.791925] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.792108] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.792217] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.792289] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.792418] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.792496] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.792629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.792738] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.794007] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 in Status: SUCCESS [ 1409.794172] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abc9ca0b-4c93-42fd-9003-750112e8dab1 deletion is rescheduled due to dependency. [ 1409.794263] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abc9ca0b-4c93-42fd-9003-750112e8dab1" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.295717] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.797687] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b336412-26a4-430f-933f-4da7b1cc33cb: rpc.has_security_group_logging(os_id): False [ 1410.814936] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.815131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.815131] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.815334] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.832219] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.832517] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.832629] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.832706] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.832901] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.832983] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.833089] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b336412-26a4-430f-933f-4da7b1cc33cb is going to be updated. [ 1410.886584] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.886791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.886791] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.886991] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.887146] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.904103] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b336412-26a4-430f-933f-4da7b1cc33cb in Status: IN_PROGRESS for 2s [ 1412.231939] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1412.232353] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1412.925080] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b336412-26a4-430f-933f-4da7b1cc33cb in Status: SUCCESS [ 1412.925080] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.234186] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.234186] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.729848] env[69637]: INFO networking_nsxv3.common.synchronization [None req-dfdb9809-ef00-4a4f-8560-247d1c2abb59 None None] Enqueued Resource ID: 5a0039b7-dbf3-4f0c-b4bd-edc08429e2ef with Priority: HIGHEST for action port [ 1418.730402] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a0039b7-dbf3-4f0c-b4bd-edc08429e2ef with Priority: HIGHEST for action port [ 1418.730708] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a0039b7-dbf3-4f0c-b4bd-edc08429e2ef taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.730985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a0039b7-dbf3-4f0c-b4bd-edc08429e2ef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.730985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a0039b7-dbf3-4f0c-b4bd-edc08429e2ef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.731224] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a0039b7-dbf3-4f0c-b4bd-edc08429e2ef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.731276] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a0039b7-dbf3-4f0c-b4bd-edc08429e2ef',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.234832] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a0039b7-dbf3-4f0c-b4bd-edc08429e2ef [ 1419.235961] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.236497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.236497] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.236716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.236716] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.236940] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a0039b7-dbf3-4f0c-b4bd-edc08429e2ef already deleted. [ 1419.237074] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a0039b7-dbf3-4f0c-b4bd-edc08429e2ef" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.731450] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.731450] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.732529] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.732893] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.952318] env[69637]: INFO networking_nsxv3.common.synchronization [req-4e40fc85-e191-44e0-b6f1-dcc50dda5107 req-30676727-b2ce-41da-844c-e111da0cd63c tempest-ServerActionsTestJSON-2076172663 tempest-ServerActionsTestJSON-2076172663-project-member] Enqueued Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 1430.952773] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 with Priority: HIGHEST for action security_group_members [ 1430.953099] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b27dfc-30ce-43c0-922c-60d619d56e60 taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.953781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.953781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.953781] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.954034] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.954034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.954034] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.954186] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.954274] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.954391] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6b27dfc-30ce-43c0-922c-60d619d56e60',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.456190] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.456426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.456426] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.456622] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.477528] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.477763] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.477882] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.477946] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.478129] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.478211] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.478300] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 is going to be updated. [ 1431.505769] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.506025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.506025] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.506150] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.506261] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.516066] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: IN_PROGRESS for 2s [ 1433.543905] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 in Status: SUCCESS [ 1433.544278] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b27dfc-30ce-43c0-922c-60d619d56e60 deletion is rescheduled due to dependency. [ 1433.544278] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b27dfc-30ce-43c0-922c-60d619d56e60" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.953649] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.954063] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1440.954615] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.954926] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1445.956107] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.956363] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1450.957073] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1450.957424] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1455.959347] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1455.959347] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1457.438769] env[69637]: INFO networking_nsxv3.common.synchronization [req-98950928-f96a-4786-9c02-e4f6dee1eb0c req-814d0239-0d06-43ca-8b7b-c1bb6b641e93 tempest-AttachVolumeShelveTestJSON-1899433646 tempest-AttachVolumeShelveTestJSON-1899433646-project-member] Enqueued Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_members [ 1457.439502] env[69637]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b336412-26a4-430f-933f-4da7b1cc33cb with Priority: HIGHEST for action security_group_members [ 1457.439920] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b336412-26a4-430f-933f-4da7b1cc33cb taken with stack trace [, , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.440114] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.440231] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.440601] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.440751] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.440985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.440985] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.441234] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.441386] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.441481] env[69637]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b336412-26a4-430f-933f-4da7b1cc33cb',) {} {{(pid=69637) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1457.945108] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.945108] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.945108] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.945400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.945400] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.945486] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.945547] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.945588] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.945734] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.945808] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.945893] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b336412-26a4-430f-933f-4da7b1cc33cb is going to be updated. [ 1457.973097] env[69637]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69637) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.973097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.973097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.973097] env[69637]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.973430] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.981731] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b336412-26a4-430f-933f-4da7b1cc33cb in Status: IN_PROGRESS for 2s [ 1459.992463] env[69637]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b336412-26a4-430f-933f-4da7b1cc33cb in Status: SUCCESS [ 1459.992850] env[69637]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b336412-26a4-430f-933f-4da7b1cc33cb deletion is rescheduled due to dependency. [ 1459.992850] env[69637]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b336412-26a4-430f-933f-4da7b1cc33cb" {{(pid=69637) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.440922] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1462.441293] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1467.442159] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1467.442159] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1472.443072] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1472.443072] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1477.444098] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1477.444810] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.445310] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1482.445680] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1487.446311] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1487.446692] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1492.447210] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1492.447602] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1497.448640] env[69637]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1497.449083] env[69637]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0